attention-audit

Tag

Cards List
#attention-audit

The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models

Hugging Face Daily Papers · 6d ago Cached

The paper introduces an audit method for prefix invariance in attention, state-space, and hybrid sequence models, demonstrating that attention masks fail to ensure causality, with 192 faults detected across multiple model checkpoints.

0 favorites 0 likes
← Back to home

Submit Feedback