training-script

Tag

#training-script

Mutating Gemma 4 31B Dense in to a native Gemma 4 additive-MoE model

Reddit r/LocalLLaMA ↗ · 2026-05-29

A proof-of-concept training script enables converting Gemma 4 31B dense model into an additive-MoE architecture, inspired by a Korean-specific finetune from JDONE-Research.

0 favorites 0 likes

← Back to home

training-script

Mutating Gemma 4 31B Dense in to a native Gemma 4 additive-MoE model

Submit Feedback