Tag
RouteSparse is a method for input-conditional pattern routing in long-context prefilling, achieving up to 6.5× speedup with minimal accuracy loss compared to dense attention.