Tag
Mooncake announces support for SSD offloading of KV cache, enabling cost-effective scaling of KV cache capacity beyond DRAM for long-lived agentic workloads, with analysis showing bimodal reuse patterns that make tiered storage efficient.
vLLM integrates Mooncake Store for distributed KV cache reuse, enabling cross-node prefix caching to efficiently serve agentic workloads with high token reuse.