Gemma 4 is still lazy
Summary
User reports that Gemma 4 is lazy and poor at multi-turn agentic tasks compared to other models like Qwen, DeepSeek, and GPT-OSS, despite being a good chatbot.
Similar Articles
Gemma 4 26b a4b is genuinely the best model I have tried for language learning and scientific queries!
User reports that Gemma 4 26b outperforms Qwen 3.5/3.6 for language learning and scientific queries, despite being behind in coding tasks, and invites discussion on other non-coding use cases for small MoE models.
Gemma 4 12b QAT is a regression for my use case, despite all the hype.. Not my main Squeeze
The author reports that the Gemma 4 12b QAT model suffers from a regression in tool calling and coding tasks compared to the standard Q5_K_L version, due to a bug involving control token misconfiguration. Despite high token speed, the model's inconsistent outputs make it unsuitable for agent workflows.
Is there any reason for a lack of love for Gemma 4 26b?
A user asks why Gemma 4 26b receives less attention compared to Qwen models, sharing their experience using these models for a personal assistant project on a 3090.
Gemma 4 31B's competence surprised me
A user shares anecdotal findings that Gemma 4 31B outperforms Qwen 3.6 models and matches Opus 4.7 in understanding and refactoring messy academic code, highlighting a benchmark (SciCode) where Gemma excels.
gemma-4-31B on Cerebras is better than ChatGPT voice mode
A claim that the Gemma-4-31B model running on Cerebras hardware outperforms ChatGPT's voice mode, demonstrated via a Hugging Face Space for real-time voice interaction.