gemma4 e2b is really good, what other small models work on crappy computers?
Summary
A user praises the Gemma 4 e2b model for its speed and output quality on low-end hardware, comparing it favorably to ChatGPT 3.5 and 4, and asks for recommendations on other small models that work well on older computers.
Similar Articles
Gemma 4 26b a4b is genuinely the best model I have tried for language learning and scientific queries!
User reports that Gemma 4 26b outperforms Qwen 3.5/3.6 for language learning and scientific queries, despite being behind in coding tasks, and invites discussion on other non-coding use cases for small MoE models.
@googlegemma: Gemma 4 E2B goes super fast on Intel AI PCs thanks to LiteRT NPU support on OpenVINO! 1.3x faster prefill performance o…
Gemma 4 E2B achieves 1.3x faster prefill and 2.8x better performance-per-watt on Intel AI PCs using OpenVINO with LiteRT NPU support, enabling efficient background LLM tasks.
Running Gemma 4 26B at 5 tokens/SEC on a 13-year-old Xeon with no GPU
A developer successfully runs Google's Gemma 4 26B mixture-of-experts model at about 5 tokens per second on a 13-year-old dual Xeon server without a GPU, using a modified version of ik_llama.cpp that works without AVX2 instructions.
Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency
Google releases Gemma 4 models optimized with Quantization-Aware Training (QAT) to improve efficiency for mobile and laptop deployment, reducing memory footprint to 1GB for the E2B model while preserving quality.
You don't need a GPU to run gemma-4-26B-A4B
The author demonstrates that the Gemma-4-26B-A4B model runs efficiently on a CPU-only system using Koboldcpp, achieving 7 tokens per second on an old desktop, suggesting that powerful GPUs may not be necessary for local LLM inference.