Tag
A discussion of whether small reasoning models (SRMs) are the next major shift, sparked by Pathway's BDH architecture and its ARC-AGI-1 result, along with a framework for evaluating compactness, few-shot adaptation, training efficiency, and continual learning beyond marketing claims.
This paper introduces FlyBy, a selective querying framework that trains small reasoning models to diagnose knowledge bottlenecks and query stronger models, improving reasoning performance on hard problems with lower serving cost.