Skip to content

Instantly share code, notes, and snippets.

@daniil-lyakhov
Created April 30, 2026 13:23
Show Gist options
  • Select an option

  • Save daniil-lyakhov/31e27fce47d16e29973123269ea1c3e3 to your computer and use it in GitHub Desktop.

Select an option

Save daniil-lyakhov/31e27fce47d16e29973123269ea1c3e3 to your computer and use it in GitHub Desktop.
benchmark_app -m pi05_libero_finetuned_hf_ov_int4/prefix_lm.xml -d GPU.0 -shape "prefix_embs[1,712,2048],prefix_att_2d_masks_4d[1,1,712,712],prefix_position_ids[1,712]" -infer_precision f16 -ip f16 -op f16 -hint throughput
benchmark_app -m pi05_libero_finetuned_hf_ov/gemma_expert_decoder.xml -shape "x_t[1,50,32],timestep[1],cache_keys[18,1,1,712,256],cache_values[18,1,1,712,256],prefix_pad_masks[1,712]" -infer_precision f16 -ip f16 -op f16 -hint throughput -d GPU.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment