attention-sorting

Tag

Cards List
#attention-sorting

Position Bias Correction is Insufficient for One-Pass Attention Sorting

arXiv cs.CL · 2026-06-29 Cached

This paper tests the hypothesis that correcting position bias in attention scores can enable single-pass document sorting for long-context QA. The authors find that while debiasing helps moderately, it does not match the accuracy of iterative sorting, indicating that repeated reordering provides additional benefits beyond bias correction alone.

0 favorites 0 likes
← Back to home

Submit Feedback