I extended Gemma4-31B to 44B (88 layers) — since Google won't give us anything bigger than 31B
Summary
A user extends Google's Gemma4-31B model to 44B parameters with 88 layers, criticizing Google for not releasing larger versions.
Similar Articles
More Gemma 4 models incoming
Google announces that more Gemma 4 models are coming, potentially including a 120B parameter model.
Talking with Gemma 4 31B!
Announcing Gemma 4 31B, a new large language model from Google.
google/gemma-4-26B-A4B-it
Google DeepMind releases Gemma 4, a family of open-weight multimodal models ranging from 2.3B to 31B parameters with support for text, image, video, and audio inputs. The models feature 256K context windows, MoE and dense architectures, enhanced reasoning capabilities, and are optimized for deployment across devices from mobile to servers.
*cough* gemma3 270M *cough*
Google releases Gemma 3, a 270M parameter language model.
I didn't give up - extGemma4-40_5B returned
A user shares their successful attempt to extend a fine-tuned Gemma model by inserting new layers, overcoming initialization failures to create extGemma4-40_5B without wrecking the original capabilities.