Kimi k3 is 2.8t! Will need to have an aggressive iQ2_XXS or IQ1.8!
Summary
Kimi has released a new 2.8 trillion parameter model, k3, which is larger than expected and will require aggressive quantization to run on consumer hardware.
Similar Articles
@eliebakouch: Kimi K3 (2.8T total parameters) is an open weight model competing with fable and gpt 5.6 sol while being much cheaper, …
Kimi K3 is an open-weight 2.8 trillion parameter LLM with innovations like linear attention, latent MoE, and new activation functions, offering competitive performance at lower cost.
Kimi K3: Open Frontier Intelligence
Kimi introduces Kimi K3, a 2.8 trillion parameter open model with native vision and 1M context, built on Kimi Delta Attention and Attention Residuals. It achieves frontier-level performance in coding and reasoning, with full weights to be released by July 2026.
@thealexker: underrated gems in Kimi-K3 release: > an early K3 wrote the majority of the kernels in the late development stages > it…
Kimi.ai released Kimi K3, a 2.8 trillion parameter multimodal model with 1 million context, featuring novel Delta Attention and Attention Residuals, and a self-optimizing stack including MiniTriton compiler. The model achieves up to 6.3x faster decoding and ~25% higher training efficiency.
Kimi k3 launching soon (probably more than 2 trillion para acc to leaks)
Kimi k3, a large language model reportedly with over 2 trillion parameters from Moonshot AI, is launching soon.
@interjc: The market still needs a disruptive force; whether you use Kimi or not, the major companies' reset cycles are increasing.
Kimi releases the K3 model, featuring 2.8 trillion parameters, a million-token context window, and native multimodal capabilities. It leverages Kimi Delta Attention and Attention Residuals to enhance inference speed and training efficiency.