state-merging

Tag

Cards List
#state-merging

Mergeable Model-Side Aggregation States for Long-Context Language Models

arXiv cs.CL ↗ · 2026-07-30 Cached

Introduces a model-side aggregation interface using compact HyperLogLog sketches to maintain set-based aggregation states for long-context language models, achieving 99.2% accuracy on benchmark tasks and eliminating the need for external execution cycles.

0 favorites 0 likes
#state-merging

Dynamic Linear Attention

Hugging Face Daily Papers ↗ · 2026-06-09 Cached

DLA introduces adaptive state merging and capacity-bounded memory modeling for multi-state linear attention, improving long-context LLM performance.

0 favorites 0 likes
← Back to home

Submit Feedback