online-softmax

Tag

Cards List
#online-softmax

Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification

Hugging Face Daily Papers ↗ · 2026-07-27 Cached

Sol-Attn introduces a training-free method to sparsify attention for video generation inference, achieving over 2x speedup by dynamically selecting key-value blocks during online softmax with minimal quality loss.

0 favorites 0 likes
← Back to home

Submit Feedback