Tag
Kimi releases the K3 model, featuring 2.8 trillion parameters, a million-token context window, and native multimodal capabilities. It leverages Kimi Delta Attention and Attention Residuals to enhance inference speed and training efficiency.