Qwen 3.6-27B Dense with MTP on Strix Halo Windows - Benchmarks

Reddit r/LocalLLaMA News
qwen benchmarks llama-cpp inference-speed mtp strix-halo windows

Summary

Community benchmarks of Qwen 3.6-27B Dense and MTP variants running via llama.cpp on Strix Halo Windows, showing token/s speeds for various tasks.

Here are some results (llama.cpp)! Task 1: write a short poem 27B Dense: 12.5 tokens/s 27B Dense MTP: (spec-draft-n-max 6): 14.5 tokens/s 27B Dense MTP (spec-draft-n-max 3): 18.7 tokens/s Task 2: edit a hello word html artifact 27B Dense: 12.6 tokens/s 27B Dense MTP (spec-draft-n-max 6): 14.2 tokens/s 27B Dense MTP (spec-draft-n-max 3): 19.8 tokens/s Task 3: create a hello world html directly in chat 27B Dense: 12.6 tokens/s 27B Dense MTP (spec-draft-n-max 6): 17.9 tokens/s 27B Dense MTP (spec-draft-n-max 3): 23.2 tokens/s It's fascinating how it varies with tasks! https://preview.redd.it/bsrlgslasn1h1.png?width=1802&format=png&auto=webp&s=8aba6c751bf7c47494ce11697b91a4347fec79af Settings used: { "name": "Qwen3.6-27B-UD-Q4\_K\_M", "file": "Qwen3.6-27B-UD-Q4\_K\_M.gguf", "custom": \["--mmproj", "C:/CarlAI/models/mmproj-Qwen\_Qwen3.6-27B-bf16.gguf"\], "backend": "vulkan", "parameters": { "temp": 0.8, "top\_k": 20, "top\_p": 0.95, "min\_p": 0.00, "repeat\_penalty": 1.0, "ngl": 99, "context\_length": 65000, "jinja": true, "flash\_attn": "on" } }, { "name": "Qwen3.6-27B-UD-Q4\_K\_XL\_MTP", "file": "Qwen3.6-27B-UD-Q4\_K\_XL\_MTP.gguf", "custom": \["-np", "1", "--spec-type", "draft-mtp", "--spec-draft-n-max", "6"\], "backend": "vulkan", "parameters": { "temp": 0.8, "top\_k": 20, "top\_p": 0.95, "min\_p": 0.00, "repeat\_penalty": 1.0, "ngl": 99, "context\_length": 65000, "jinja": true, "flash\_attn": "on" } },
Original Article

Similar Articles

Qwen3.5-122B-Q5-MTP - Qwen3.5-122B-Q6-MTP

Reddit r/LocalLLaMA

Benchmark comparison of Qwen3.5-122B Q5 and Q6 quantized models using llama.cpp with multi-token prediction on Strix Halo, showing throughput of 20.24 t/s and 17.17 t/s respectively.

@Snixtp: https://x.com/Snixtp/status/2055734339346768225

X AI KOLs Timeline

A user benchmarks the MTP variant of Qwen3.6 27B against the normal version on a single RTX 3090 using llama.cpp, finding MTP offers up to 2.37x faster generation at long contexts (32k-64k) but with slower prefill and no concurrency support yet.

More Qwen3.6-27B MTP success but on dual Mi50s

Reddit r/LocalLLaMA

The article benchmarks the Qwen3.6-27B model using Multi-Token Prediction (MTP) and tensor parallelism on dual Mi50 GPUs, demonstrating significant speedups via llama.cpp.