representation-auditing

Tag

Cards List
#representation-auditing

What Softmax Throws Away: Mass-Aware Attention for Evidence Accumulation

arXiv cs.LG ↗ · 2026-07-28 Cached

The paper proposes Mass-Aware Attention (MAA), a generalization of standard attention normalization that retains evidence accumulation information by scaling numerator and denominator at different rates under repetition, improving representation informativeness and task performance across temporal graph and other domains.

0 favorites 0 likes
← Back to home

Submit Feedback