Skip to content

Instantly share code, notes, and snippets.

@sasasin

sasasin/bench-r9700-opencode-balanced-128k.csv

Last active May 5, 2026 14:44
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save sasasin/fa6f6d1c66747ab95267cafef7d51be6 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save sasasin/fa6f6d1c66747ab95267cafef7d51be6 to your computer and use it in GitHub Desktop.
Download ZIP
llama-server を VRAM 32GB でイイ感じに実行する
Raw
bench-r9700-opencode-balanced-128k.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T12:59:18Z","3346415600","19761957","76.501883","0.448819"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T12:59:35Z","4043392920","15790870","63.313933","0.246076"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T13:00:09Z","4709741540","20308501","54.356232","0.234245"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T13:01:07Z","6140649820","15334500","41.689607","0.104142"
Raw
bench-r9700-opencode-fast-64k.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T12:56:40Z","2983297280","21044908","85.814482","0.600471"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","8192","2026-05-05T12:56:55Z","3106081280","32665245","82.426212","0.861551"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","16384","2026-05-05T12:57:14Z","3271581680","18866841","78.251679","0.447943"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T12:57:37Z","3659545300","20395176","69.955774","0.387598"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T12:58:09Z","4313676380","20727110","59.347223","0.284208"
Raw
bench-r9700-opencode-long-262k.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T13:03:48Z","4679222340","19267165","54.710685","0.224583"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T13:04:45Z","6126052420","39161294","41.790102","0.266650"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T13:06:52Z","7842653820","32915719","32.642471","0.136699"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T13:13:17Z","9198357900","12360194","27.831095","0.037410"
Raw
bench-r9700-qwen36-ncmoe-sweep-q4kv.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T07:48:34Z","2933391966","32006415","87.277868","0.946564"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T07:48:43Z","3625572033","20213027","70.611006","0.392480"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T07:49:08Z","4266151433","19077982","60.008045","0.267956"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T07:49:54Z","5735111533","23400064","44.637814","0.182134"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T07:52:02Z","7345020133","27172541","34.853865","0.129128"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T07:57:59Z","8795330266","37954590","29.106716","0.125802"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","4","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T08:08:37Z","4257113866","143870150","60.179725","2.001332"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","4","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T08:08:50Z","4717535866","17703926","54.266127","0.203209"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","4","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T08:09:28Z","5435841400","79863791","47.101640","0.695835"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","4","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T08:10:40Z","6722005066","20255025","38.084105","0.114557"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","4","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T08:13:15Z","8367484500","27947529","30.594847","0.102354"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","4","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T08:19:44Z","9764127400","15627899","26.218466","0.042000"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","8","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T08:31:03Z","5258909266","187584163","48.719796","1.703124"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","8","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T08:31:18Z","5858115566","9641098","43.700139","0.071937"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","8","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T08:32:10Z","6557363700","30378359","39.040637","0.180384"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","8","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T08:33:44Z","7936178100","12184005","32.257391","0.049480"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","8","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T08:37:03Z","9563909800","17704129","26.767357","0.049567"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","8","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T08:43:17Z","10936788333","2506519","23.407238","0.005360"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","12","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T08:54:55Z","6209939666","254950126","41.269591","1.657272"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","12","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T08:55:13Z","6795055533","1613219","37.674454","0.008931"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","12","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T08:56:18Z","7499180133","8600565","34.137095","0.039125"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","12","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T08:58:15Z","9040716900","10569659","28.316364","0.033106"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","12","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T09:02:17Z","10558170933","22060132","24.246694","0.050603"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","12","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T09:08:59Z","12132792833","50829877","21.100088","0.088452"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","16","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T09:20:10Z","7176165633","306175300","35.715958","1.487524"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","16","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T09:20:31Z","7717710633","13984329","33.170531","0.060133"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","16","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T09:21:49Z","8426893666","9390822","30.378954","0.033840"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","16","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T09:24:08Z","10002866833","20892353","25.592738","0.053498"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","16","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T09:28:53Z","11673207866","10375548","21.930573","0.019483"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","16","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T09:36:39Z","13060352800","22786927","19.601348","0.034181"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","24","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T09:47:41Z","9014069233","447409802","28.445502","1.373677"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","24","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T09:48:08Z","9478015700","24155122","27.009990","0.068936"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","24","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T09:49:50Z","10220265900","11067135","25.048292","0.027119"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","24","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T09:52:52Z","11883017733","7608089","21.543355","0.013796"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","24","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T09:58:59Z","13619136200","28526577","18.797136","0.039362"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","24","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T10:08:49Z","15127029533","23305648","16.923376","0.026066"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","32","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T10:22:31Z","10917068633","480472522","23.479177","1.010901"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","32","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T10:23:04Z","11251302700","17924823","22.752959","0.036263"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","32","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T10:25:09Z","12023253400","16430413","21.292100","0.029100"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","32","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T10:28:54Z","13648125366","11923591","18.757164","0.016392"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","32","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T10:36:17Z","15492151233","22713299","16.524520","0.024238"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","32","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T10:48:05Z","17109704733","51572465","14.962359","0.045022"
Raw
bench-r9700-qwen36-pp-batch-sweep-q8kv.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:28:47Z","214977900","672829","2381.655689","7.443155"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:28:49Z","875591166","3243793","2339.012528","8.651943"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:28:52Z","3716660433","23594782","2204.188281","13.946297"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:29:07Z","7878926300","54809112","2079.538311","14.480157"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:29:38Z","17388655600","39200378","1884.453394","4.249622"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:30:48Z","167858233","2132432","3050.518766","38.471478"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:30:49Z","675627566","3693356","3031.316024","16.518007"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:30:51Z","2837882433","1308246","2886.659807","1.329278"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:31:03Z","6013258766","26461017","2724.680998","12.011880"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:31:27Z","13510125266","19064121","2425.443351","3.422816"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:32:21Z","168905633","1337299","3031.404808","23.947715"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:32:22Z","674259433","1141316","3037.412316","5.136030"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:32:24Z","2845477300","2513651","2878.956110","2.542161"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:32:36Z","5990555766","20170760","2734.992304","9.215231"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:33:00Z","13518197000","29087245","2423.999382","5.217321"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:33:54Z","223073966","3892120","2295.666977","39.905572"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:33:55Z","892443700","12647862","2295.129625","32.493688"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:33:59Z","3757242833","32172367","2180.428907","18.691034"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:34:14Z","7831320733","15191825","2092.117240","4.060314"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:34:45Z","17373119866","75342043","1886.155783","8.172747"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:35:55Z","165605433","1424521","3091.839264","26.727065"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:35:55Z","672055800","4045770","3047.439851","18.399547"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:35:58Z","2822405500","8234739","2902.505175","8.482711"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:36:09Z","5974451000","11628151","2742.350955","5.341090"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:36:33Z","13494669500","11149139","2428.219151","2.006923"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:37:27Z","166365000","1551748","3077.749088","28.736015"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:37:28Z","538737766","782868","3801.483778","5.523828"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:37:30Z","2248715433","5352985","3642.982484","8.668955"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:37:39Z","4817380233","6182942","3401.022380","4.363298"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:37:59Z","11253668466","267212109","2912.841982","68.249249"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:38:44Z","219424300","2099941","2333.521711","22.406531"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:38:45Z","893073300","15581768","2293.669144","39.920793"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:38:48Z","3718746166","25247715","2202.960481","14.903150"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:39:03Z","7848595533","12912320","2087.511005","3.432511"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:39:35Z","17300763400","64736449","1894.038183","7.101214"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:40:44Z","164628233","573049","3110.062780","10.842049"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:40:45Z","672854333","2399847","3043.775292","10.873223"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:40:47Z","2804063366","11970736","2921.510051","12.444358"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:40:59Z","5962509833","14238973","2747.846588","6.562922"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:41:23Z","13444548866","16754399","2437.272847","3.035026"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:42:16Z","165782233","762201","3088.432252","14.163945"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:42:17Z","537503066","1703383","3810.236357","12.089716"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:42:19Z","2241303100","5800678","3655.032916","9.465489"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:42:28Z","4793261266","10994117","3418.144062","7.850139"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:42:48Z","11063197266","11964513","2961.894716","3.200960"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:43:32Z","217909633","1699837","2349.692713","18.247280"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:43:33Z","895892033","1314409","2285.993021","3.351087"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:43:36Z","3709555666","22975737","2208.407202","13.674494"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:43:51Z","7860660666","27808334","2084.320567","7.373813"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","256","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:44:23Z","17354889766","41812340","1888.120711","4.549336"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:45:32Z","164891166","1901498","3105.354106","35.864669"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:45:33Z","673408866","1907173","3041.259270","8.620459"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:45:36Z","2813242866","22668743","2912.067788","23.420193"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:45:47Z","5957758500","7705832","2750.030613","3.554296"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:46:11Z","13441800966","16372426","2437.770985","2.967040"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","512","0","0","2026-05-05T07:47:05Z","165405033","842398","3095.485467","15.808299"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","2048","0","0","2026-05-05T07:47:05Z","537047400","3341689","3813.542275","23.774134"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","8192","0","0","2026-05-05T07:47:07Z","2237922666","1900146","3660.539326","3.104777"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","16384","0","0","2026-05-05T07:47:16Z","4788324533","14824331","3421.678034","10.611735"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","4096","1024","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","32768","0","0","2026-05-05T07:47:36Z","11057271900","11857841","2963.481898","3.177623"
Raw
bench-r9700-qwen36-tg-batch-sweep-q4kv.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:04:26Z","2923700833","26479125","87.565022","0.788925"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:04:35Z","3612079433","25692513","70.875684","0.502209"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:05:04Z","4258419666","26500913","60.117745","0.372782"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:05:58Z","5715936166","6102517","44.787098","0.047827"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:08:31Z","3015895733","127789844","84.983525","3.538922"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:08:40Z","3616047333","21298426","70.797165","0.415585"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:09:04Z","4259164833","26871360","60.107270","0.377845"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:09:50Z","5728103600","35844108","44.693092","0.278744"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:11:42Z","2939359000","37295554","87.103104","1.097638"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:11:51Z","3620180533","22756323","70.716562","0.442913"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:12:15Z","4259056533","27803069","60.108910","0.390990"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:13:01Z","5682847733","19629110","45.048195","0.155298"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:14:49Z","2919430600","17571448","87.690443","0.525987"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:14:58Z","3616176366","29348595","70.796102","0.571937"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:15:26Z","4258009100","23618191","60.123224","0.332435"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:16:21Z","5720934933","37715616","44.749223","0.294088"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:18:46Z","2985164633","75908598","85.794328","2.177721"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:18:55Z","3616982433","25103732","70.779495","0.489302"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:19:19Z","4256023300","21273411","60.151046","0.299806"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:20:05Z","5686445733","14139689","45.019519","0.111782"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:21:52Z","2926951533","17305573","87.465044","0.515375"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:22:01Z","3614800500","30808198","70.823366","0.600692"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:22:23Z","4266682800","24779368","60.001118","0.347301"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:23:04Z","5678840933","13212655","45.079784","0.104747"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:24:40Z","2917951700","12499951","87.733847","0.375341"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:24:49Z","3613568533","30486789","70.847443","0.594824"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:25:17Z","4262578233","24855254","60.058906","0.349075"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","256","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:26:12Z","5710318100","15079926","44.831336","0.118450"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:28:37Z","2992731700","79999077","85.581379","2.289804"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:28:46Z","3619868166","24780689","70.723008","0.482247"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:29:10Z","4258775900","26555564","60.112722","0.373500"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:29:56Z","5688193800","13560532","45.005669","0.107150"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T11:31:44Z","2924543100","11196805","87.535895","0.334423"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T11:31:52Z","3611567233","26594403","70.885906","0.519776"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T11:32:14Z","4267640300","30003014","59.988280","0.420053"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","2048","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:32:55Z","5685031500","14979400","45.030741","0.118471"
Raw
bench-r9700-qwen36-tg-long-batch-sweep-q4kv.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:34:46Z","5676449800","15039668","45.098822","0.119327"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T11:36:33Z","7333419433","14341109","34.908770","0.068261"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T11:42:21Z","8870680266","25146503","28.859272","0.081765"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T11:52:54Z","5851623700","14545484","43.748721","0.108848"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T11:55:15Z","7438878333","37037482","34.414358","0.170867"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T12:01:04Z","8921306633","31514270","28.695587","0.101282"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T12:11:40Z","5923750833","43764149","43.217439","0.320163"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T12:13:46Z","7468289100","46942029","34.279168","0.215296"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T12:19:33Z","8960945833","12274363","28.568449","0.039120"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T12:29:52Z","5822891166","26863499","43.965037","0.202293"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T12:31:51Z","7451722266","27202884","34.354779","0.125149"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","1024","1024","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T12:37:13Z","10098881966","9537112","25.349356","0.023924"
Raw
bench-r9700-qwen36-tg-q4kv-fullgpu.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T06:44:14Z","3024791066","33650506","84.640900","0.937834"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","8192","2026-05-05T06:44:23Z","3158944066","53602904","81.055150","1.362348"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","16384","2026-05-05T06:44:36Z","3325123233","28725032","76.993440","0.661999"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T06:44:52Z","3717782533","25869133","68.860467","0.477858"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T06:45:17Z","4377748666","21230059","58.478463","0.283464"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T06:46:03Z","5879287900","44393021","43.544351","0.330230"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T06:48:29Z","7555514500","45159649","33.883346","0.202985"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q4_0","q4_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T06:54:53Z","8818822066","32010702","29.029075","0.105272"
Raw
bench-r9700-qwen36-tg-q8kv-fullgpu.csv
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 1 column, instead of 41 in line 1.
HIP Library Path: C:\WINDOWS\SYSTEM32\amdhip64_7.dll
build_commit,build_number,cpu_info,gpu_info,backends,model_filename,model_type,model_size,model_n_params,n_batch,n_ubatch,n_threads,cpu_mask,cpu_strict,poll,type_k,type_v,n_gpu_layers,n_cpu_moe,split_mode,main_gpu,no_kv_offload,flash_attn,devices,tensor_split,tensor_buft_overrides,use_mmap,use_direct_io,embeddings,no_op_offload,no_host,fit_target,fit_min_ctx,n_prompt,n_gen,n_depth,test_time,avg_ns,stddev_ns,avg_ts,stddev_ts
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","0","2026-05-05T07:05:47Z","2996641166","20448326","85.431630","0.582350"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","8192","2026-05-05T07:05:57Z","3188526666","27428403","80.291840","0.693002"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","16384","2026-05-05T07:06:09Z","3411875533","41037585","75.039239","0.897068"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","32768","2026-05-05T07:06:26Z","3779795466","35516402","67.732498","0.633063"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","65536","2026-05-05T07:06:51Z","4565721366","25977314","56.071210","0.318920"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","131072","2026-05-05T07:07:38Z","6202321433","25205820","41.275323","0.167897"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","200000","2026-05-05T07:10:23Z","30408464066","78529759","8.418746","0.021747"
"d05fe1d7d","9010","AMD Ryzen 9 3900XT 12-Core Processor ","AMD Radeon AI PRO R9700","ROCm","C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf","qwen35moe 35B.A3B MXFP4 MoE","21695154688","34660610688","512","512","12","0x0","0","50","q8_0","q8_0","99","0","layer","0","0","1","auto","0.00","none","1","0","0","0","0","0","0","0","256","262144","2026-05-05T07:17:34Z","9574105966","4666970","26.738793","0.013031"
Raw
bench.sh
#!/bin/bash -v
# 0. まずバックエンド確認用の短いベンチ
# 最初にこれを実行して、Vulkan か ROCm/HIP で R9700 が認識されているか確認してください。
# 出力の backend が Vulkan、HIP、ROCm 系になっていればOKです。
# もし CPU になっていたら、AMD対応ビルドではないので、Vulkan版またはROCm/HIP版の llama.cpp に切り替える必要があります。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 512 \
-ub 512 \
-p 512 \
-n 64 \
-r 1 \
-o md
# 1. 全量GPU寄せ TG ベンチ / q4_0 KV
# まずはこれが本命です。
# RTX 5070 時代の -ncmoe を外し、Qwen3.6-35B-A3B をR9700にできるだけ載せ切る前提で測ります。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 512 \
-ub 512 \
-p 0 \
-n 256 \
-d 0,8192,16384,32768,65536,131072,200000,262144 \
-r 3 \
-o csv > bench-r9700-qwen36-tg-q4kv-fullgpu.csv
# 2. q8_0 KV でも測る
# 32GB VRAMなら、q8_0 KV でもかなり現実的です。
# 品質・安定性寄りではこちらも確認してください。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q8_0 \
-ctv q8_0 \
-b 512 \
-ub 512 \
-p 0 \
-n 256 \
-d 0,8192,16384,32768,65536,131072,200000,262144 \
-r 3 \
-o csv > bench-r9700-qwen36-tg-q8kv-fullgpu.csv
# 3. PP / Prompt Processing ベンチ
# OpenCodeではここが重要です。
# RTX 5070 + Qwen3.5-9B で 4,000 tok/s 前後出ていましたが、R9700 + Qwen3.6-35B-A3B でどこまで出るかを見ます。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q8_0 \
-ctv q8_0 \
-b 512,1024,2048,4096 \
-ub 256,512,1024 \
-p 512,2048,8192,16384,32768 \
-n 0 \
-r 3 \
-o csv > bench-r9700-qwen36-pp-batch-sweep-q8kv.csv
# 4. -ncmoe をあえて振るベンチ
# R9700 32GBでは基本的に -ncmoe は不要なはずです。
# ただし、長contextやq8_0 KVでVRAM余裕を見るために、少しだけCPU offloadした場合も比較しておく価値があります。
# ただし、本命はあくまで -ncmoe 指定なしです。
# このベンチは「長contextで崖落ちしないか」「VRAM安全バッファを作ると速度がどれだけ落ちるか」を確認するためです。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-ncmoe 0,4,8,12,16,24,32 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 512 \
-ub 512 \
-p 0 \
-n 256 \
-d 0,32768,65536,131072,200000,262144 \
-r 3 \
-o csv > bench-r9700-qwen36-ncmoe-sweep-q4kv.csv
# もし -ncmoe 0 がエラーになる場合は、0 を外してこれにします。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 512,1024,2048 \
-ub 256,512,1024 \
-p 0 \
-n 256 \
-d 0,32768,65536,131072 \
-r 3 \
-o csv > bench-r9700-qwen36-tg-batch-sweep-q4kv.csv
# 5. batch / ubatch をTG側でも振る
# R9700では、5070時代より -b / -ub を大きくしても耐える可能性があります。
# TG側でも確認します。
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 512,1024 \
-ub 512,1024 \
-p 0 \
-n 256 \
-d 131072,200000,262144 \
-r 3 \
-o csv > bench-r9700-qwen36-tg-long-batch-sweep-q4kv.csv
# 6. OpenCode想定の実用プロファイル比較
# 最終的に OpenCode で使うなら、以下の3系統を比較するのが分かりやすいです。
# A. fast 64k
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 1024 \
-ub 512 \
-p 0 \
-n 256 \
-d 0,8192,16384,32768,65536 \
-r 5 \
-o csv > bench-r9700-opencode-fast-64k.csv
# B. balanced 128k
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 1024 \
-ub 512 \
-p 0 \
-n 256 \
-d 0,32768,65536,131072 \
-r 5 \
-o csv > bench-r9700-opencode-balanced-128k.csv
# C. long 200k / 262k
llama-bench.exe \
-m "C:\Users\sasas\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-fa 1 \
-ctk q4_0 \
-ctv q4_0 \
-b 512 \
-ub 512 \
-p 0 \
-n 256 \
-d 65536,131072,200000,262144 \
-r 5 \
-o csv > bench-r9700-opencode-long-262k.csv
# 8. 結果から llama-server に落とす判断基準
# ベンチ後はこう見ます。
# 1. q8_0 KV が q4_0 KV とほぼ同速
# → llama-server は q8_0 KV でよい
# 2. q8_0 KV が長contextで落ちる
# → q4_0 KV を採用
# 3. -b 1024 が PP/TG ともに速い
# → llama-server は -b 1024 -ub 512
# 4. -b 512 と 1024 が僅差
# → 安全側で -b 512 -ub 512
# 5. -ncmoe 0/full GPU が最速かつ安定
# → llama-server では -ncmoe を指定しない
# 6. 長contextだけ不安定
# → -c 131072 または 200000 に落とす
#
#ただし、ベンチで q8_0 KV が問題なければ：
# --cache-type-k q8_0 --cache-type-v q8_0
# に変更してよいです。
Raw
start-llama-server-vram32gb.sh
#！/bin/bash -v
# llama-server を VRAM 32GB でイイ感じに実行する。
# llama-bench でいろいろ模索した結果をチャッピーに分析させて、あんたの用途ならこのあたりがええんじゃないすか、で出てきたパラメータ
# kvキャッシュに詰めこむほどに応答性能は劣化していくので、128k あたりでセッションを打ち切るのがいいと思われる
llama-server.exe \
-m "${USERPROFILE}\.lmstudio\models\unsloth\Qwen3.6-35B-A3B-GGUF\Qwen3.6-35B-A3B-MXFP4_MOE.gguf" \
-ngl 99 \
-c 262144 \
-fa on \
--cache-type-k q4_0 \
--cache-type-v q4_0 \
-b 2048 \
-ub 1024 \
-t 12 \
-tb 12 \
-np 1 \
--cache-prompt \
--cache-reuse 128 \
--slot-prompt-similarity 0.20 \
--no-webui \
--metrics \
--host 127.0.0.1 \
--port 8080
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment