prefill-speedup

Tag

Cards List
#prefill-speedup

@no_stp_on_snek: busy evening in custom rust kernel and swift dispatch land. 3 of the 9 PRs are genuine new or changed metal kernels. th…

X AI KOLs Timeline · 2026-07-07 Cached

在自定义Rust内核和Swift调度逻辑的优化下,Qwen3.6-35b-A3B模型的预填速度在2k提示下从255 tok/s提升到1058 tok/s,实现了约4倍的加速,解码和困惑度未受影响。

0 favorites 0 likes
← Back to home

Submit Feedback