Qwen3.6 35b Q2_XXS: Being GPU poor in 2026 is not so bad
Summary
Demonstrates running the quantized Qwen3.6-35B model on a low-end laptop to create a Zelda-like RPG in 24 minutes, showing that GPU-poor scenarios are manageable in 2026.
Similar Articles
@sudoingX: update: qwen 3.6 27b dense q4 just one shotted octopus invaders game on a single 3090. hermes agent drove the whole thi…
A user benchmark demonstrates that the Qwen 3.6 27B dense model (Q4 quantized) can autonomously generate a fully playable multi-file game in a single prompt on a single RTX 3090, significantly outperforming its predecessor with zero manual interventions. The results highlight major improvements in local code generation and agentic capabilities for consumer-grade hardware.
Running Qwen3.6-35B-A3B on a laptop RTX 4060 (8GB) — what worked, what didn't, and a surprising speculative-decoding result
A detailed account of running the Qwen3.6-35B-A3B MoE model on an 8GB laptop GPU, covering effective optimizations like --no-mmap and VRAM headroom, unexpected findings where speculative decoding improved speed by 26% contrary to benchmarks, and pitfalls with Windows and CPU bottlenecks.
Running Qwen 3.6 35B A3B-Q8_0 gguf on a cheap radeon 7600 at 18 token/s * update increased to 21 t/s
User reports running Qwen 3.6 35B A3B-Q8_0 gguf on a Radeon 7600 with llama.cpp and ROCm, achieving 21 tokens per second after VRAM overclocking, with a note about a display-related performance bug.
yall are sleeping on qwen 3.8 27b q2 + q2 dflash + q5 kv
A user shares their experience running a quantized Qwen 3.8 27B model using QAT Q2 and Q5 KV, achieving high performance on a 12GB GPU with up to 200K token context, surpassing models like Sonnet 4.6.
Qwen 30b MoE - 30tps - 6GB vram - Done!
A user shares success running Qwen 30B MoE on an RTX 3050 6GB with 90k context at 30-35 tokens per second, celebrating low-end hardware performance.