What speed is everyone getting on Qwen3.6 27b?

Reddit r/LocalLLaMA Tools
llamacpp qwen3.6 inference-speed multi-gpu quantization

Summary

User benchmarks Qwen3.6-27B-Q8_0 at ~13 tokens/sec on 3 mixed GPUs with 128k context via llama.cpp, asking if performance is typical.

I'm getting \~13 tps on Q8\_0, with a context window of 128000, K Q8\_0, V Q8\_0 this is on 3x GPUS (1x2060super 8gb, 2x5060ti 16gb), via llamacpp unsure if this is slow or to be expected? \*/llama-server --port 8080 --model \*/llama.cpp/Qwen3.6-27B-Q8\_0/Qwen3.6-27B-Q8\_0.gguf -mm \*/Qwen3.6-27B-Q8\_0/mmproj-BF16.gguf -np 1 --temperature 1.0 --top-p 0.95 --top-k 20 --min-p 0.0 --presence-penalty 1.5 --repeat-penalty 1.0 --chat-template-kwargs '{"preserve\_thinking": true}' --cache-type-k q8\_0 --cache-type-v q8\_0 -c 128000 --fit-target 1536 (--fit-target 1536 was to allow some space for the vision capability to work)
Original Article

Similar Articles

Running Qwen3.6 35b a3b on 8gb vram and 32gb ram ~190k context

Reddit r/LocalLLaMA

The author shares a high-performance local inference configuration for running Qwen3.6 35B A3B on limited hardware (8GB VRAM, 32GB RAM) using a modified llama.cpp with TurboQuant support, achieving ~37-51 tok/sec with ~190k context.

Qwen 3.6 benchmarks on 2x RTX PRO 6000

Reddit r/LocalLLaMA

Benchmarks for Qwen 3.6 27B and 35B models on dual RTX PRO 6000 GPUs using VLLM, showing generation throughput up to 3500 tokens per second.

Best Settings for 48GB VRAM + Qwen 3.6 27B

Reddit r/LocalLLaMA

A user shares optimized settings for running Qwen3.6 27B (Q8_0) on a dual GPU setup (RTX 4090 + RTX 3090) with llama.cpp, achieving 75-100 t/s and 1500 pp with 250k context.