Tag
This paper studies the interaction between prompt breadth and rollout refresh in on-policy distillation for mathematical reasoning, revealing that prompt efficiency depends on both the refresh rate of student policies and the inference budget.