@JiaZhihao: Excited to share Lithos’ serving stack for Kimi K2.7 Code, a 1T-parameter frontier coding model. On a single 8×B200 nod…
Summary
Lithos announces its inference engine serving Kimi K2.7 Code, achieving over 1,000 tokens/sec per user on a single 8×B200 node at native precision, 3.4–5.7× faster than major providers.
View Cached Full Text
Cached at: 07/11/26, 12:19 AM
Excited to share Lithos’ serving stack for Kimi K2.7 Code, a 1T-parameter frontier coding model.
On a single 8×B200 node, Lithos peaks above 1,000 tokens/sec per user on coding workloads while preserving the model’s native precision, full quality, and no added approximation.
For agents, faster tokens reduce the latency of each reasoning, coding, and iteration step. We believe ultra-fast inference changes your agentic experience.
Try it here: http://lithosai.com
LithosAI
Source: https://www.lithosai.com/
1,000 tokens per second
Speed is the new agent differentiator.
Without Lithos
174–291tok / s
HARNESSClaude Code•Codex•Your harness
MODELKimi K2.7 Code
INFERENCE
Major Providers
With Lithos
1,000tok / s3.4–5.7×faster
HARNESSClaude Code•Codex•Your harness
MODELKimi K2.7 Code
INFERENCE
Lithos Engine
Kimi K2.7 Code, 1T parameters, on 8×B200. Model-native precision. Zero approximation. Full model quality. 3.4–5.7× faster than major providers.
LithosAI (@lithos_ai): Today we’re launching Lithos’ agentic inference engine starting with Kimi K2.7 Code, a frontier open-source 1T parameter coding model.
On a single standard 8xB200 GPU node, performance peaks above 1,000 tok/s per user on coding workloads at model-native precision, with no
Similar Articles
@HotAisle: Kimi K2.6 + DFlash: 508 tok/s on 8x MI300X 5.6x throughput improvement over baseline autoregressive serving 90 tok/s → …
Kimi K2.6 paired with DFlash inference system achieves 508 tokens/s on 8×AMD MI300X, a 5.6× throughput jump from 90 tokens/s baseline with zero quality loss.
@YRSM_Simon: This is big news! Kimi 2.6 is a generative-level model. In this age of overflowing LLM capabilities, speed will become the deciding factor in competition. Is the chip sector about to see another 'sector rotation'? 😅
Cerebras is now running Kimi K2.6, a trillion-parameter model, in enterprise trials at ~1,000 tokens/s, the fastest frontier model performance ever measured by Artificial Analysis.
@QuixiAI: @Kimi_Moonshot K2.6 running on my mi300x, 56 tps (single request). I will run a throughput test
Kimi K2.6 achieves 56 tokens per second on a single MI300X GPU; user plans further throughput benchmarking.
@jun_song: Working on fitting Kimi-K2.6 (1T) on 128GB Mac. Trying to get 40tok/s, and minimize the quality loss.
A developer is optimizing the Kimi-K2.6 (1T) model to run efficiently on a 128GB Mac, targeting 40 tokens per second while minimizing quality loss.
Kimi K2.7 Code feels more useful than flashy
Kimi released K2.7 Code, a coding-focused AI model with improved benchmarks and 30% lower thinking token usage, emphasizing practical performance in long coding loops and agent tool integration rather than flashy scores.