@LambLabs: Meet Woolly We post-trained Qwen3-8B to run up to 2–3× faster on math & coding prompts and, more importantly, to fit on…
Summary
LambLabs introduces Woolly, a post-training technique that accelerates Qwen3-8B by 2-3x for math and coding tasks, enabling it to run on their chip, with a live demo available.
View Cached Full Text
Cached at: 08/22/26, 05:18 AM
Meet Woolly 🐑
We post-trained Qwen3-8B to run up to 2–3× faster on math & coding prompts and, more importantly, to fit on our chip.
The technique works with any LLM, regardless of size or quantization.
Live demo this week → https://t.co/7K5HUfVq5Z https://t.co/dA2FuDo2ag
A Woolly Qwen3-8B
Source: https://woolly.trylittlelamb.com/ checking both engines
Left · original
standard decoding
The original model’s response will unfold here.
Output— tok/s
First token—
Elapsed—
Right · accelerated
A WoollyQwen3-8B
Woolly accelerated decoding
Woolly
The Woolly response will appear here.
Output— tok/s
First token—
Elapsed—
Ready for the same prompt in both lanes
Try
Similar Articles
Qwen3.8-27B: slower tokens, faster and better results
Qwen3.8-27B is a new AI model that emphasizes wall-clock time over token speed, offering superior intelligence for local deployment on consumer hardware with 32 GB VRAM.
Running Qwen3.6 35b a3b on 8gb vram and 32gb ram ~190k context
The author shares a high-performance local inference configuration for running Qwen3.6 35B A3B on limited hardware (8GB VRAM, 32GB RAM) using a modified llama.cpp with TurboQuant support, achieving ~37-51 tok/sec with ~190k context.
@xdotli: my friend @xeophon thinks coding is solved here's validation that a 3b model is trained with focus on algo efficiency a…
Nanbeige 4.1, a 3B model, outperforms Qwen3-30b-A3b and Qwen 3.5 4b in coding tasks with focus on algorithmic efficiency, achieving long horizon tasks with 600+ tool calls.
Tested in Coding: Q8_K_XL Qwen3.8 27B vs BF16 Qwen3.6 27B
A user's detailed comparison of Qwen3.8 and Qwen3.6 models in coding tasks, highlighting improvements in instruction following and tracing for Qwen3.8, but with inefficiencies in reasoning.
@_lewtun: You can now have an AI researcher running on your laptop 24/7 for free! Running Qwen3-35B-A3B with llama.cpp and a 4-bi…
The article highlights the ability to run Qwen3-35B-A3B locally on a laptop for free using llama.cpp and Unsloth 4-bit quantization.