Gemma 4 Quadruple Release, 12B, 12B QAT, 26B-A4B QAT and 31B QAT Uncensored Heretics!

Reddit r/LocalLLaMA Models
gemma-4 uncensored fine-tuning quantization open-source nlp

Summary

llmfan46 released a quadruple set of uncensored, fine-tuned and quantized Gemma-4 models on Hugging Face, including 12B, 26B-A4B, and 31B variants with QAT and GGUF formats.

**gemma-4-31B-it-qat-q4\_0-unquantized-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-unquantized-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic) GGUF: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF) GPTQ-Int4: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-GPTQ-Int4](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4) **gemma-4-26B-A4B-it-qat-q4\_0-unquantized-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-unquantized-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic) GGUF: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF) GPTQ-Int4: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-GPTQ-Int4](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4) **gemma-4-12B-it-qat-q4\_0-unquantized-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-unquantized-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-unquantized-uncensored-heretic) GGUF: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF) **gemma-4-12B-it-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic) GGUFs: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF) I even made some NVFP4 Safetensors and NVFP4 GGUF of standard Gemma 4 31B it since someone requested them: **gemma-4-31B-it-uncensored-heretic:** NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4) NVFP4 GGUFs: [https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF) Doing all this took many days as well as a lot of work and effort, so I hope the community can make good use of these models. As usual all releases come with benchmarks too. Find all my models here: [HuggingFace-LLMFan46](https://huggingface.co/llmfan46/models)
Original Article
View Cached Full Text

Cached at: 06/12/26, 02:54 AM

llmfan46 (LLMfan46)

Source: https://huggingface.co/llmfan46/models

llmfan46’s models 175

#### llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4 Any-to-Any• 12B• Updatedabout 3 hours ago #### llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF Any-to-Any• 12B• Updatedabout 3 hours ago #### llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-GGUF Any-to-Any• 12B• Updatedabout 3 hours ago #### llmfan46/gemma-4-12B-it-qat-q4_0-unquantized-uncensored-heretic Any-to-Any• 12B• Updatedabout 3 hours ago #### llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF Any-to-Any• 12B• Updatedabout 4 hours ago • 1 #### llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF Any-to-Any• 12B• Updatedabout 4 hours ago • 1 #### llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4 Any-to-Any• 12B• Updatedabout 4 hours ago #### llmfan46/gemma-4-12B-it-uncensored-heretic Any-to-Any• 12B• Updatedabout 4 hours ago #### llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4 Image-Text-to-Text• 26B• Updatedabout 5 hours ago #### llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4 Image-Text-to-Text• 26B• Updatedabout 5 hours ago #### llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF Image-Text-to-Text• 25B• Updatedabout 5 hours ago • 1 #### llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF Image-Text-to-Text• 31B• Updatedabout 5 hours ago • 1 #### llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GGUF Image-Text-to-Text• 25B• Updatedabout 5 hours ago • 1 #### llmfan46/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic Image-Text-to-Text• 26B• Updatedabout 5 hours ago #### llmfan46/gemma-4-31B-it-uncensored-heretic Image-Text-to-Text• 31B• Updatedabout 7 hours ago • 9.85k • 58 #### llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF Image-Text-to-Text• 31B• Updatedabout 7 hours ago • 1 #### llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4 Image-Text-to-Text• 31B• Updatedabout 7 hours ago #### llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GGUF Image-Text-to-Text• 31B• Updatedabout 7 hours ago • 2 #### llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4 Image-Text-to-Text• 31B• Updatedabout 7 hours ago #### llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4 Image-Text-to-Text• 31B• Updatedabout 7 hours ago • 1 #### llmfan46/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic Image-Text-to-Text• 31B• Updatedabout 8 hours ago • 2 #### llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF Image-Text-to-Text• 35B• Updated14 days ago • 40.1k • 88 #### llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-NVFP4-Experts-Only-GGUF Image-Text-to-Text• 35B• Updated14 days ago • 3.85k • 3 #### llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic-GGUF 31B• Updated14 days ago • 13.4k • 15 #### llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF Image-Text-to-Text• Updated14 days ago • 72.9k • 93 #### llmfan46/Qwen3.6-27B-uncensored-heretic-v2-NVFP4-MLP-Only Image-Text-to-Text• 27B• Updated15 days ago • 191 #### llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic Image-Text-to-Text• 31B• Updated15 days ago • 653 • 10 #### llmfan46/Qwen3.5-27B-uncensored-heretic-v2-Native-MTP-Preserved Image-Text-to-Text• 27B• Updated15 days ago • 1.08k • 5 #### llmfan46/Qwen3.6-27B-uncensored-heretic-v2 Image-Text-to-Text• 27B• Updated15 days ago • 4.18k • 28 #### llmfan46/gpt-oss-120b-heretic-v2-GGUF Text Generation• 117B• Updated15 days ago • 1.21k • 12

Similar Articles

Gemma 4 26B-A4B GGUF Benchmarks

Reddit r/LocalLLaMA

Unsloth has released KL Divergence benchmarks for Gemma 4 26B-A4B GGUF quantizations, showing Unsloth GGUFs top 21 of 22 sizes on the Pareto frontier. They also introduced a new UD-IQ4_NL_XL quant fitting in 16GB VRAM and updated Q6_K and MLX quants for both Gemma 4 and Qwen3.6.