Tag
A technical analysis of optimizing LLM inference using agent fleets, based on DeepSeek 4.1 Flash optimization reaching 2300 tok/s, highlighting that most gains come from configs/graphs rather than new kernels, questioning megakernel approaches, and emphasizing verification and convergence in automated optimization runs.
This paper presents an automated tensor scheduling approach for hybrid CPU-GPU LLM inference on consumer devices.