random-attention

The paper proposes Random Attention, a KV cache eviction method that uses random selection instead of scoring, matching selective methods while improving throughput in reasoning tasks.

Introduces Random Attention (RA), a lightweight temporal modeling module for mobile sleep staging that uses fixed random projections for similarity-based aggregation, achieving competitive performance with minimal additional parameters.