@populartourist: Having worked consistently with Qwen3.6 27B NVFP4 on repos - it's clear that this quant is not reliable, at least for c…
Summary
The user reports that the Qwen3.6 27B NVFP4 quantization is unreliable for coding, with inconsistent quality despite high throughput, and suggests that Q4_K_M may be more consistent.
View Cached Full Text
Cached at: 06/15/26, 09:09 PM
Having worked consistently with Qwen3.6 27B NVFP4 on repos - it’s clear that this quant is not reliable, at least for coding.
Quality is all over the place - results either really good or poor.
Throughput is amazing but it loses on debugging churn.
Ornestein Q6_K has been the dark horse so far.
I’m confident Q4_K_M can be more consistent than this NVFP4 variant.
wd 🔺 (@populartourist): Good quality Qwen3.6 27B NVFP4 grafted MTP, with image.
Fits RTX 5090 up to 180/190k context window with FP8 KV for max_num_seqs 1 - can fit more if you dont exhaust context in parallel.
Code work sees 2-8k tok/s throughput with peaks of +11k with MTP.
Initial quality looks
Similar Articles
Qwen 27B 3.8 quants: How low can you go?
A user shares their positive experience with low quantizations of Qwen 27B 3.8 on a Mac mini M4, using Unsloth's Q3 XXS quant, and asks for others' experiences with sub-Q3 quants.
Qwen3.6-27B Quantization Benchmark
This article benchmarks various Qwen3.6-27B quantizations (Q8 to Q2) using KLD and Same Top P metrics, comparing providers like Unsloth and mradermacher, and offers recommendations for quality-size trade-offs.
Qwen 3.6 27B - VLLM Performance Benchmark Results (BF16, FP8, NVFP4)
A detailed benchmark of Qwen 3.6 27B using VLLM across BF16, FP8, and NVFP4 quantizations, showing NVFP4 fastest for token generation but FP8 best for prompt processing, with practical advice on choosing the right quantization for coding tasks.
Qwen 3.8 27b is strong even at Q3_xxs
The user finds Qwen 3.8 27b in Q3 quantization highly effective for coding tasks with fast inference speeds, outperforming previous models, despite minor issues in general conversations.
I can't get Qwen3.6 27B to outperform Qwen-Coder-Next and I'm not sure why
A user reports that Qwen-Coder-Next outperforms Qwen3.6 27B in both real-world tests and synthetic benchmarks, despite others praising 27B, and seeks advice on possible setup issues.