@thealexker: underrated gems in Kimi-K3 release: > an early K3 wrote the majority of the kernels in the late development stages > it…
Summary
Kimi.ai released Kimi K3, a 2.8 trillion parameter multimodal model with 1 million context, featuring novel Delta Attention and Attention Residuals, and a self-optimizing stack including MiniTriton compiler. The model achieves up to 6.3x faster decoding and ~25% higher training efficiency.
View Cached Full Text
Cached at: 07/16/26, 10:23 PM
underrated gems in Kimi-K3 release:
an early K3 wrote the majority of the kernels in the late development stages
it built a triton-class compiler from scratch, MiniTriton, that delivers performance on par with or better than Triton and torch.compile then it designed a chip, by a model, for a model, in one 48-hour autonomous run
the model is rewriting and optimizing every layer of the stack it runs on: kernels for its own training. A compiler for its own kernels. silicon for its own weights.
we’re watching software build its own hardware
Kimi.ai (@Kimi_Moonshot): Introducing Kimi K3: Open Frontier Intelligence
🔹 2.8 Trillion Parameters, 1 Million Context, Native Multimodal 🔹 Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts 🔹 Attention Residuals deliver ~25% higher training efficiency at <2% additional
Similar Articles
Kimi K3: Open Frontier Intelligence
Kimi introduces Kimi K3, a 2.8 trillion parameter open model with native vision and 1M context, built on Kimi Delta Attention and Attention Residuals. It achieves frontier-level performance in coding and reasoning, with full weights to be released by July 2026.
Kimi K3 released on web and app
Kimi K3, a new AI model with 2.8 trillion parameters and 1 million context length, has been released on web and app, featuring leading capabilities in coding, agentic tasks, reasoning, vision, and agent swarms.
Kimi K3, and what we can still learn from the pelican benchmark
Chinese AI lab Moonshot AI announced Kimi K3, a 2.8 trillion parameter open-weights model, claiming it is the first open 3T-class model and beating several leading models on benchmarks. The article also discusses the model's pricing and a fun pelican SVG benchmark test.
Kimi K3 Benchmarks
Kimi K3 has achieved notable results in recent AI benchmarks, showcasing its capabilities.
@eliebakouch: Kimi K3 (2.8T total parameters) is an open weight model competing with fable and gpt 5.6 sol while being much cheaper, …
Kimi K3 is an open-weight 2.8 trillion parameter LLM with innovations like linear attention, latent MoE, and new activation functions, offering competitive performance at lower cost.