Qwen3.5-122B-Q5-MTP - Qwen3.5-122B-Q6-MTP

Reddit r/LocalLLaMA Models

Summary

Benchmark comparison of Qwen3.5-122B Q5 and Q6 quantized models using llama.cpp with multi-token prediction on Strix Halo, showing throughput of 20.24 t/s and 17.17 t/s respectively.

for anyone who cares... 😄 prompt = spen a 1000 tokens unsloth MTP models strix halo llama.cpp:server-rocm-mtp \\ \--spec-type draft-mtp \\ \--spec-draft-n-max 3 ***Qwen3.5-122B-Q5-MTP-General*** n\_decoded = 100 tg = ***29.77 t/s*** n\_decoded = 179 tg = 27.95 t/s n\_decoded = 254 tg = 26.80 t/s n\_decoded = 4056 tg = 20.23 t/s n\_decoded = 4120 tg = 20.23 t/s n\_decoded = 4181 tg = ***20.22 t/s*** prompt eval time = 408.99 ms / 19 tokens eval time = 207516.64 ms / 4200 tokens ***tg = 20.24 t/s*** ***Qwen3.5-122B-Q6-MTP-General*** n\_decoded = 102 tg = ***25.10 t/s*** n\_decoded = 174 tg = 24.25 t/s n\_decoded = 225 tg = 22.04 t/s n\_decoded = 3193 tg = 17.27 t/s n\_decoded = 3244 tg = 17.26 t/s n\_decoded = 3281 tg = ***17.18 t/s*** prompt eval time = 488.39 ms / 19 tokens eval time = 191156.72 ms / 3283 tokens ***tg = 17.17 t/s***
Original Article

Similar Articles

More Qwen3.6-27B MTP success but on dual Mi50s

Reddit r/LocalLLaMA

The article benchmarks the Qwen3.6-27B model using Multi-Token Prediction (MTP) and tensor parallelism on dual Mi50 GPUs, demonstrating significant speedups via llama.cpp.

Testing llama.cpp MTP support on Qwen3.6 - RTX 5090

Reddit r/LocalLLaMA

A technical test of llama.cpp's new Multi-Token Prediction (MTP) support using Qwen3.6 models on an RTX 5090, comparing performance with and without MTP across different prompts and GGUF quantizations.