Tag
Pulsar Attention replaces the static anchor in Star Attention with content-aware summaries and attention sinks, reducing FLOPs by 3.3x while outperforming dense attention on long-context benchmarks.