Tag
This article reports on the independent research paper 'Attention Projection Mixing with Exogenous Anchors' by 17-year-old high school student Su Tinghao, which was accepted into the ICML main conference, proposing the ExoFormer model to address the over-smoothing issue in Transformers.