The first Gemma 4 12B finetunes are ready
Summary
The first finetuned variants of the Gemma 4 12B model are now available on Hugging Face, offered in GGUF format by multiple developers.
Similar Articles
Gemma 4 Quadruple Release, 12B, 12B QAT, 26B-A4B QAT and 31B QAT Uncensored Heretics!
llmfan46 released a quadruple set of uncensored, fine-tuned and quantized Gemma-4 models on Hugging Face, including 12B, 26B-A4B, and 31B variants with QAT and GGUF formats.
G4-Meromero-31B-Uncensored-Heretic Is Out Now, a Finetune of Gemma 4 31B It Designed for Creative Tasks, With Kld of 0.0100 and 15/100 Refusals!
G4-Meromero-31B-Uncensored-Heretic is a finetune of Gemma 4 31B that reduces refusal rate to 15/100 while keeping KL divergence at 0.01, preserving model quality. It is designed for creative tasks and available as GGUF quantizations on Hugging Face.
Unsloth Gemma 4 QAT MTP assistant models now available
Unsloth released Gemma 4 QAT MTP assistant models as GGUF files on Hugging Face, available in q8_0 and larger quantization formats.
@LyalinDotCom: If you're waiting Gemma 4 12b through @ollama, its here: gemma4:12b gemma4:12b-it-q4_K_M gemma4:12b-it-q8_0 gemma4:12b-…
Gemma 4 12b models are now available on Ollama, offering various quantized versions for local AI inference.
More Gemma 4 models incoming
Google announces that more Gemma 4 models are coming, potentially including a 120B parameter model.