@danielhanchen: We also released 1-bit Qwen3.8-27B quants which run on 8GB RAM. They retain ~77% of accuracy compared to BF16. We origi…
Summary
Unsloth AI released 1-bit quantized versions of the Qwen3.8-27B AI model that run on 8GB RAM, retaining approximately 77% accuracy compared to BF16 precision.
View Cached Full Text
Cached at: 08/20/26, 12:48 AM
We also released 1-bit Qwen3.8-27B quants which run on 8GB RAM.
They retain ~77% of accuracy compared to BF16.
We originally didn’t want to release them but were shocked that they worked extremely well on our internal testing!
Unsloth AI (@UnslothAI): We’re releasing new Qwen3.8-27B GGUFs with 10% higher accuracy.
Unsloth Dynamic V3 outperforms others by >10% on Div-300, KLD & more benchmarks.
We also release 1-bit quants that retain 77% accuracy. Run on 8GB RAM.
Blog: https://t.co/tHsBexyh2K GGUF:
Similar Articles
@UnslothAI: Qwen3.8 can now be run locally! We shrank Qwen3.8-2.4T-A95B from 4.9TB to 397GB (-91% size) via Dynamic 1-bit by select…
Unsloth announces that Qwen3.8 can now run locally, shrinking the 2.4T-parameter model from 4.9TB to 397GB via Dynamic 1-bit quantization, with a guide and GGUF release.
My Qwen3.8-27B task-aware quant reaches 99% of BF16 reasoning performance at 15% of the size.
A new task-aware quantization method called TAK achieves near-BF16 reasoning performance at significantly reduced model size, outperforming Unsloth on various AI models.
@sudoingX: this lab took qwen 3.6 27b, the model i've been calling king of the 24gb tier all month, and crushed it down to 3.9gb. …
PrismML announces Bonsai 27B, a binary-quantized version of Qwen3.6 27B that runs on a phone using only 1.125 bits per weight, claiming 89.5% intelligence retention. The model is being independently tested by @sudoingX to verify performance.
@UnslothAI: Qwen3.8-27B is coming! Will run locally on 17GB RAM/VRAM setups.
Alibaba announces Qwen3.8-27B open-weights release, capable of running locally on 17GB RAM/VRAM, alongside the larger Qwen3.8-Max.
My Qwen 3.8 27B tests on limited VRAM (16-20GB)
This article tests various quantized versions of the Qwen 3.8 27B AI model on limited VRAM setups, comparing their performance on tasks like animation generation, app development, and word generation.