Unsloth fix on Mistral Small 4?
Summary
Unsloth has released updated quantizations (GGUF format) for Mistral Small 4 (119B parameters). All quant versions have been updated.
Similar Articles
unsloth/Qwen3.6-27B-GGUF
Unsloth releases a GGUF quantized version of the Qwen3.6-27B model, featuring improved agentic coding capabilities, tool calling, and support for Unsloth Studio.
Unsloth Minimax M3 GGUF
Unsloth is uploading a GGUF quantized version of the MiniMax M3 model to Hugging Face.
Unsloth Quantization of Laguna S 2.1 Is Out
Unsloth released GGUF quantizations of the Laguna S 2.1 Mixture-of-Experts model, a 118B parameter coding model with 8B active parameters, 1M context window, and agentic capabilities. The quantized versions enable efficient local deployment.
Unsloth Gemma 4 QAT MTP assistant models now available
Unsloth released Gemma 4 QAT MTP assistant models as GGUF files on Hugging Face, available in q8_0 and larger quantization formats.
unsloth/gemma-4-12B-it-qat-GGUF
Unsloth releases GGUF quantized versions of Google DeepMind's Gemma 4 models, optimized with Quantization-Aware Training (QAT) to reduce memory requirements while preserving quality, supporting multiple formats and sizes for diverse deployment.