@no_stp_on_snek: Pretty dang good. ran some tests myself. it's a pretty good model IMO:
Summary
NVIDIA's 4-bit quantized Qwen3.6-27B model (NVFP4) is reported to be near-lossless, maintaining full-size quality at a quarter the size.
View Cached Full Text
Cached at: 07/02/26, 06:27 PM
@Raitziger Pretty dang good. ran some tests myself. it’s a pretty good model IMO: https://t.co/Fqg63UQzkK
Tom Turney (@no_stp_on_snek): ok folks you know the drill.. verdict up front:
NVIDIA’s 4-bit Qwen3.6-27B (NVFP4) is near-lossless. on my own held-out behavioral tests it’s basically indistinguishable from the full bf16 model, which is the whole point: full-size quality and character at a quarter the size.
Similar Articles
@no_stp_on_snek: ok folks you know the drill.. verdict up front: NVIDIA's 4-bit Qwen3.6-27B (NVFP4) is near-lossless. on my own held-out…
NVIDIA's 4-bit quantized Qwen3.6-27B (NVFP4) is found to be near-lossless compared to the full bf16 model, with behavioral differences being minor and random rather than systematic, making it a practical drop-in replacement.
@no_stp_on_snek: So, i wanted to test TwoTowers from Nvidia but it was a bit big. So i quantized it. but the speed is very slow. looks l…
A 4-bit quantization of NVIDIA's TwoTower block-diffusion LM (Nemotron-Labs-TwoTower-30B-A3B-Base) that compresses both towers into ~38 GB, enabling single-GPU inference at slow speeds (~2-4 tok/s).
@Ex0byt: Days of model activations, slicing, splicing, fine-tuning + 15 hours of nail-biting NVFP4 calibration/propagation passe…
A community member released Qwen3.6-35B-A3B-PRISM-NVFP4, a multi-pass, dataset-calibrated zero-loss NVFP4 quantized variant of the Qwen model.
@rasbt: Crazy model! It actually uses the old Qwen2.5-Coder-3B stack and got really great performance with their post-training …
A 3B parameter model using the Qwen2.5-Coder-3B stack achieves coding benchmark scores comparable to Claude Opus 4.5, with detailed post-training techniques including synthetic data, filtering, two-stage SFT, and a novel RL method (MGPO).
@MiaAI_lab: FYI the best Qwen 3.6 35b nvfp4 to run is the @NVIDIAAI nvfp4. Do not use unsloth nvfp4, it performs worse. https://hug…
NVIDIA's nvfp4 quantized version of Qwen 3.6 35B is recommended over the Unsloth variant, offering better performance. The model is available on HuggingFace for use in AI applications.