WorldKV: Efficient World Memory with World Retrieval and Compression
Summary
WorldKV is a training-free framework that retrieves and compresses key-value cache chunks to maintain long-term consistency in video diffusion world generation, achieving higher throughput while matching full-memory fidelity.
View Cached Full Text
Cached at: 05/22/26, 02:24 AM
Paper page - WorldKV: Efficient World Memory with World Retrieval and Compression
Source: https://huggingface.co/papers/2605.22718
Abstract
WorldKV enables persistent world generation in video diffusion models by retrieving and compressing key-value cache chunks to maintain consistency while improving throughput.
Autoregressive video diffusion modelshave enabled real-time, action-conditioned world generation. However, sustaining a persistent world, where revisiting a previously seen viewpoint yields consistent content, remains an open problem. FullKV-cache attentionpreserves this consistency but breaks real-time constraints: memory footprint and attention cost grow linearly with rollout length.Sliding window inferencerestores throughput but discards long-term consistency. We propose WorldKV, a training-free framework with two components:World RetrievalandWorld Compression.World Retrievalstores evicted KV-cache chunks in GPU/CPU memory and selectively retrieves scene-relevant chunks via camera/ action correspondence, inserting them back into the nativeattention windowwithout re-encoding.World Compressionprunes redundant tokens within each chunk viakey-key similarityto an anchor frame, halving per-chunk storage to fit 2x more history under a fixed budget. On Matrix-Game-2.0 and LingBot- World-Fast, WorldKV matches or exceeds full-KV memory fidelity at roughly 2x the throughput, and is competitive with memory-trained baselines without any fine-tuning. Project Page: https://cvlab-kaist.github.io/WorldKV/
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2605\.22718
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.22718 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.22718 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.22718 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Napster's homepage is now entirely AI agents. It's a clean test case for how fast training data goes stale.
Napster has pivoted to an AI agent platform, illustrating how AI training data quickly becomes outdated, leading models to provide confident but incorrect information about company identities.
@dejavucoder: lots of people talk about prompt caching and inference optimisation these days. i wrote a long ass blog once upon a tim…
The article explains how prompt caching works in LLM inference using paged attention and prefix caching, with practical tips for developers to optimize performance.
Same retrieval, different answers: 32 of 500 LongMemEval results flipped
This article highlights that benchmark scores for Engrava, a memory layer tool, can vary due to reader or judge stage variance even when retrieval results are unchanged, using LongMemEval results to illustrate the issue.
Learning how to Forget: Fine-tuning for Long-Context Sparse Attention
This paper presents a novel method for fine-tuning transformer language models with sparse attention to enable efficient long-context inference, often outperforming models trained with exact attention, and introduces an efficient implementation and a new open-source library.
ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agents
ReCache is a framework for efficient KV cache reuse and compression in tool-augmented LLM agents, achieving significant speedup and memory reduction while maintaining performance.