Tag
Explains the memory challenge of expanding transformer context windows due to quadratic attention complexity, and hints at solutions.