episodic-pretraining

Tag

Cards List
#episodic-pretraining

Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing

Hugging Face Daily Papers ↗ · 3d ago Cached

The paper introduces RouteFM, a foundation model for LLM routing that learns reusable routing capabilities via episodic pretraining across heterogeneous environments, allowing a frozen router to adapt to new domains, modalities, and candidate pools through behavioral context alone. RouteFM outperforms the strongest baseline by 2.23 quality points on MMR-Bench with only eight observations per candidate, supporting a 'pretrain once, route anywhere' paradigm.

0 favorites 0 likes
← Back to home

Submit Feedback