Tag
Pulsar Attention replaces the static anchor in Star Attention with content-aware summaries and attention sinks, reducing FLOPs by 3.3x while outperforming dense attention on long-context benchmarks.
This thread shares strategies to reduce token usage in AI agents, including prompt caching, context summarization, using smaller models, trimming tool outputs, subagents, RAG, and tight system prompts.