repair-methods

Tag

Cards List
#repair-methods

Contiguity, Not Importance: Budgeted Repair of Stale KV Caches After Document Edits

arXiv cs.AI · 3d ago Cached

The paper investigates budgeted repair methods for stale KV caches in LLM systems after document edits, demonstrating that contiguous edit-local windows efficiently recover performance and are faster than full re-prefill.

0 favorites 0 likes
← Back to home

Submit Feedback