Is Gemma 4 E4B still the best small model for a local, tool-calling personal assistant? What am I missing?
Summary
A user asks whether Gemma 4 E4B remains the best small multimodal model (under 8B/6GB) for running a local, tool-calling personal assistant on a Mac via MLX, noting failures with Ling 3.0 tiny, LFM models, and Qwen 3.5 4B/9B.
Similar Articles
Gemma 4 26b a4b is genuinely the best model I have tried for language learning and scientific queries!
User reports that Gemma 4 26b outperforms Qwen 3.5/3.6 for language learning and scientific queries, despite being behind in coding tasks, and invites discussion on other non-coding use cases for small MoE models.
Is there a better small model than Qwen3.5 4B for a fast local AI assistant?
The article asks if there are better small AI models than Qwen3.5 4B for building a fast local assistant, focusing on improving capabilities like conversation, reasoning, multilingual support, and tool calling while maintaining speed.
Google’s Gemma 4 12B just dropped - here’s how to run it locally on your Mac
Google released Gemma 4 12B, an Apache 2.0 open-source multimodal model supporting text, vision, and audio with a 256K context window. The article provides a guide for running it locally on Macs using Ollama, LM Studio, or llama.cpp.
gemma4 e2b is really good, what other small models work on crappy computers?
A user praises the Gemma 4 e2b model for its speed and output quality on low-end hardware, comparing it favorably to ChatGPT 3.5 and 4, and asks for recommendations on other small models that work well on older computers.
Ling 3.0 Tiny is the strongest, fastest and greatest model on my low end PC!
The user praises the Ling 3.0 Tiny AI model for being fast and efficient on low-end PCs, comparing it favorably to models like Qwen 3.5 9b and Gemma 12.