Gemma 4 四重发布：12B、12B QAT、26B-A4B QAT 和 31B QAT 无审查异端版

Reddit r/LocalLLaMA 模型
gemma-4 uncensored fine-tuning quantization open-source nlp

摘要

llmfan46 在 Hugging Face 上发布了一组四重未经审查、微调并量化的 Gemma-4 模型，包括 12B、26B-A4B 和 31B 变体，提供 QAT 和 GGUF 格式。

**gemma-4-31B-it-qat-q4\_0-unquantized-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-unquantized-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic) GGUF: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF) GPTQ-Int4: [https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4\_0-uncensored-heretic-GPTQ-Int4](https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4) **gemma-4-26B-A4B-it-qat-q4\_0-unquantized-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-unquantized-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic) GGUF: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF) GPTQ-Int4: [https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4\_0-uncensored-heretic-GPTQ-Int4](https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4) **gemma-4-12B-it-qat-q4\_0-unquantized-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-unquantized-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-unquantized-uncensored-heretic) GGUF: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4\_0-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF) **gemma-4-12B-it-uncensored-heretic:** Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic) GGUFs: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF) NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4) NVFP4 GGUF: [https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF) 应某人要求，我还制作了一些标准 Gemma 4 31B it 的 NVFP4 Safetensors 和 NVFP4 GGUF：**gemma-4-31B-it-uncensored-heretic:** NVFP4 Safetensors: [https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4](https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4) NVFP4 GGUFs: [https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF](https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF) 完成所有这些工作花费了数天时间，付出了大量努力，因此我希望社区能够充分利用这些模型。和往常一样，所有发布版本都附带了基准测试。在此查看我的所有模型：[HuggingFace-LLMFan46](https://huggingface.co/llmfan46/models)
查看原文
查看缓存全文

缓存时间: 2026/06/12 02:54

llmfan46 (LLMfan46)

来源：https://huggingface.co/llmfan46/models

llmfan46 (https://huggingface.co/llmfan46) 的模型 175

llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4 任意到任意• 12B• 约3小时前更新 (https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4)

llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF 任意到任意• 12B• 约3小时前更新 (https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF)

llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-GGUF 任意到任意• 12B• 约3小时前更新 (https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-uncensored-heretic-GGUF)

llmfan46/gemma-4-12B-it-qat-q4_0-unquantized-uncensored-heretic 任意到任意• 12B• 约3小时前更新 (https://huggingface.co/llmfan46/gemma-4-12B-it-qat-q4_0-unquantized-uncensored-heretic)

llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF 任意到任意• 12B• 约4小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-GGUF)

llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF 任意到任意• 12B• 约4小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4-GGUF)

llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4 任意到任意• 12B• 约4小时前更新 (https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic-NVFP4)

llmfan46/gemma-4-12B-it-uncensored-heretic 任意到任意• 12B• 约4小时前更新 (https://huggingface.co/llmfan46/gemma-4-12B-it-uncensored-heretic)

llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4 图像-文本到文本• 26B• 约5小时前更新 (https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4)

llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4 图像-文本到文本• 26B• 约5小时前更新 (https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4)

llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF 图像-文本到文本• 25B• 约5小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF)

llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF 图像-文本到文本• 31B• 约5小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4-GGUF)

llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GGUF 图像-文本到文本• 25B• 约5小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-uncensored-heretic-GGUF)

llmfan46/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic 图像-文本到文本• 26B• 约5小时前更新 (https://huggingface.co/llmfan46/gemma-4-26B-A4B-it-qat-q4_0-unquantized-uncensored-heretic)

llmfan46/gemma-4-31B-it-uncensored-heretic 图像-文本到文本• 31B• 约7小时前更新 • 9.85k • 58 (https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic)

llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF 图像-文本到文本• 31B• 约7小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4-GGUF)

llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4 图像-文本到文本• 31B• 约7小时前更新 (https://huggingface.co/llmfan46/gemma-4-31B-it-uncensored-heretic-NVFP4)

llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GGUF 图像-文本到文本• 31B• 约7小时前更新 • 2 (https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GGUF)

llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4 图像-文本到文本• 31B• 约7小时前更新 (https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-GPTQ-Int4)

llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4 图像-文本到文本• 31B• 约7小时前更新 • 1 (https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-uncensored-heretic-NVFP4)

llmfan46/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic 图像-文本到文本• 31B• 约8小时前更新 • 2 (https://huggingface.co/llmfan46/gemma-4-31B-it-qat-q4_0-unquantized-uncensored-heretic)

llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF 图像-文本到文本• 35B• 14天前更新 • 40.1k • 88 (https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF)

llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-NVFP4-Experts-Only-GGUF 图像-文本到文本• 35B• 14天前更新 • 3.85k • 3 (https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-NVFP4-Experts-Only-GGUF)

llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic-GGUF 31B• 14天前更新 • 13.4k • 15 (https://huggingface.co/llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic-GGUF)

llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF 图像-文本到文本• 14天前更新 • 72.9k • 93 (https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF)

llmfan46/Qwen3.6-27B-uncensored-heretic-v2-NVFP4-MLP-Only 图像-文本到文本• 27B• 15天前更新 • 191 (https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2-NVFP4-MLP-Only)

llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic 图像-文本到文本• 31B• 15天前更新 • 653 • 10 (https://huggingface.co/llmfan46/Gemma-4-Harmonia-31B-uncensored-heretic)

llmfan46/Qwen3.5-27B-uncensored-heretic-v2-Native-MTP-Preserved 图像-文本到文本• 27B• 15天前更新 • 1.08k • 5 (https://huggingface.co/llmfan46/Qwen3.5-27B-uncensored-heretic-v2-Native-MTP-Preserved)

llmfan46/Qwen3.6-27B-uncensored-heretic-v2 图像-文本到文本• 27B• 15天前更新 • 4.18k • 28 (https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2)

llmfan46/gpt-oss-120b-heretic-v2-GGUF 文本生成• 117B• 15天前更新 • 1.21k • 12 (https://huggingface.co/llmfan46/gpt-oss-120b-heretic-v2-GGUF)

  • 上一页
  • 1 (https://huggingface.co/llmfan46/models?p=0)
  • 2 (https://huggingface.co/llmfan46/models?p=1)
  • 3 (https://huggingface.co/llmfan46/models?p=2)
  • ... (https://huggingface.co/llmfan46/models#)
  • 6 (https://huggingface.co/llmfan46/models?p=5)
  • 下一页 (https://huggingface.co/llmfan46/models?p=1)

相似文章

Gemma 4 26B-A4B GGUF 基准测试

Reddit r/LocalLLaMA

嘿，r/LocalLLaMA 社区，我们为不同提供方的 Gemma 4 26B-A4B GGUF 进行了 KL 散度（KL Divergence）基准测试，以帮助大家挑选最佳的量化版本。* 平均 KL 散度结果使几乎所有 **Unsloth GGUF 都位于帕累托前沿** * KLD 用于衡量量化模型与原始 BF16 输出分布的匹配程度，从而反映模型保留的精度。* 这使得 Unsloth 在 21/22 种尺寸中**表现最佳。**99.9% KLD 及其他指标也呈现相似趋势。* 我们还更新了我们的 Q6_K 量化版本以提高动态性。此前，它们...