Kimi K3 is like an F1 machine inside a show window.

Reddit r/LocalLLaMA Models

Summary

Moonshot has released Kimi K3, an extremely large AI model that is virtually impossible to run on local workstations even with multiple RTX 6000 Blackwell GPUs, prompting the author to seek ways to run it via hacking or distillation.

Moonshot dropped Kimi K3, and as expected, it’s a absolute monster. Even with 2~4x RTX 6000 Blackwell local workstations, running a model natively is virtually impossible. It feels like an F1 machine inside a show window. Does anyone trying to hack this monster? or Is anyone with datacenter/cluster capacity or sponsor? I either carve this monster down myself, or wait for someone to distill it. Either way, I really want to see it run — simply because it's there. P.S. Save your 'AI Slop' comments. I experienced enough of you guys yesterday.
Original Article

Similar Articles

Kimi-K3 is published on HuggingFace

Reddit r/artificial

Moonshot AI has released Kimi-K3, a 2.8T-parameter mixture-of-experts model with 1M token context window, available on HuggingFace under a permissive license with commercial limitations.