Tag
This paper presents a pre-registered negative result on training mixture-of-experts routers for cache locality against memory-bandwidth walls, showing that miss reduction trades off with language modeling quality despite training mechanisms.