model-mutation

Tag

#model-mutation

Mutating Gemma 4 31B Dense in to a native Gemma 4 additive-MoE model

Reddit r/LocalLLaMA ↗ · 2026-05-29

A proof-of-concept training script enables converting Gemma 4 31B dense model into an additive-MoE architecture, inspired by a Korean-specific finetune from JDONE-Research.

0 favorites 0 likes

← Back to home

model-mutation

Mutating Gemma 4 31B Dense in to a native Gemma 4 additive-MoE model

Submit Feedback