Kimi K2.6 Unsloth GGUF is out
Summary
Unsloth has released a GGUF-quantized version of the Kimi K2.6 model, enabling efficient local inference.
Similar Articles
unsloth/Kimi-K2.6-GGUF
Unsloth releases quantized GGUF versions of the open-source 1T-parameter Kimi K2.6 MoE model, optimized for long-horizon coding, autonomous agent swarms, and production-ready design tasks.
unsloth/Kimi-K2.7-Code-GGUF
Unsloth releases GGUF quantizations of Kimi K2.7 Code, a 1 trillion parameter MoE coding model built on Kimi K2.6 with improved token efficiency and agentic coding capabilities.
New Unsloth KImi K3 drops! Q1_0 (466GB), TQ1_0(509GB), IQ1_M(649),TQ2_0(551GB)!!
Unsloth releases new GGUF quantizations of Kimi K3, ranging from 466GB to 649GB, enabling efficient deployment of the large model.
Unsloth Minimax M3 GGUF
Unsloth is uploading a GGUF quantized version of the MiniMax M3 model to Hugging Face.
Anyone tried the Q1 Kimi K3 yet? (555GB)
Kimi K3 is a massive 2.9 trillion parameter mixture-of-experts model with 104B active parameters, 1M context length, and native MXFP4 training, now available in GGUF quantizations ranging from 540GB to smaller sizes, though requiring substantial hardware to run.