@antirez: Uploading a new HF imatrix GGUF for 2 bits: same name, different content with fixed down layer of shared experts (there…
Summary
A corrected 2-bit GGUF model file has been uploaded to Hugging Face after fixing a bug in the imatrix computation, leading to improved logits recall and reduced error.
Similar Articles
@aisearchio: GLM 5.2 GGUF is already here! 8-bit is ~half the size of the full model. Smaller versions coming soon https://huggingfa…
GLM 5.2 GGUF quantized model is released, with 8-bit version half the size of the full model; smaller versions are coming soon.
Unsloth Minimax M3 GGUF
Unsloth is uploading a GGUF quantized version of the MiniMax M3 model to Hugging Face.
huihui-ai/Huihui-GLM-5.2-abliterated-GGUF
A quantized GGUF version of the abliterated GLM-5.2 model is released on Hugging Face, enabling local inference with various tools like Transformers, llama.cpp, and vLLM.
New tensor type layouts for my GGUF uploads
The author shares a blog post about new tensor type layouts for GGUF uploads, detailing research that shows improved model quantization performance.
@support_huihui: New GGUF: huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF This is an uncensored version of empero-ai/Qw…
A new uncensored GGUF quantized version of the Qwythos-9B-Claude-Mythos-5-1M model, created using abliteration, is released on Hugging Face.