@mr_r0b0t: Call the homies, new @UnslothAI NVFP4 just dropped
Summary
Unsloth AI releases new NVFP4 quantized Qwen3.6 models that run 2.5x faster on GPUs, with improved accuracy and tool calling capability.
View Cached Full Text
Cached at: 07/10/26, 10:16 PM
Call the homies, new @UnslothAI NVFP4 just dropped 🔥 https://t.co/Y7RQKPiWhC
Unsloth AI (@UnslothAI): We’re releasing new Qwen3.6 quants that run 2.5× faster on your GPU.
Qwen3.6-27B NVFP4 runs on 24GB VRAM. 35B-A3B can hit 17,561 tok/s (B200).
We also improved accuracy, tool calling, agent use, and looping.
Guide: https://t.co/EEQIlFrR0c Qwen3.6 NVFP4:
Similar Articles
2.5x faster Qwen3.6 NVFP4 Unsloth quants
Unsloth releases quantized Qwen3.6 models using NVFP4 format, achieving 2.5x faster inference speeds.
@MiaAI_lab: FYI the best Qwen 3.6 35b nvfp4 to run is the @NVIDIAAI nvfp4. Do not use unsloth nvfp4, it performs worse. https://hug…
NVIDIA's nvfp4 quantized version of Qwen 3.6 35B is recommended over the Unsloth variant, offering better performance. The model is available on HuggingFace for use in AI applications.
@MiaAI_lab: Nvidia did it again! @NVIDIAAI's Qwen 3.6 27B NVFP4 is faster than Unsloth's Qwen 3.6 27B NVFP4 by a whopping ~41% on D…
Nvidia's optimized Qwen 3.6 27B NVFP4 model achieves 41% faster single-session inference and 23-25% faster concurrent inference on DGX Spark compared to Unsloth's version.
@no_stp_on_snek: This is huge. 3090 class gpus rejoice!
Unsloth AI releases quantized Qwen3.6 models that run 2.5× faster on consumer GPUs, with the 27B model fitting in 24GB VRAM and the 35B-A3B achieving high throughput.
@0xkeenz: Interesting, I was just studying the differences between Unsloth and NVIDIA's Qwen3.6 27B NVFP4 yesterday, and today Unsloth updated! The new Unsloth's quantization approach is very similar to NVIDIA's official solution: instead of choosing between BF16 and ...
Unsloth releases a new version of Qwen3.6 27B NVFP4 quantization scheme, introducing FP8_E4M3 intermediate precision layer and refined weight protection, achieving 2.5x speed improvement on 24GB VRAM, while improving accuracy and tool-calling capabilities.