behavior-imbalance

Tag

Cards List
#behavior-imbalance

Behavior Leverage Imbalance in Multi-Teacher On-Policy Distillation

arXiv cs.CL · 2026-07-09 Cached

This paper identifies a failure mode in multi-teacher on-policy distillation for agentic language models where the student becomes over-reliant on tool-calling, and proposes Soft Clamp, a per-token divergence calibration method that reduces over-calling without sacrificing accuracy.

0 favorites 0 likes
← Back to home

Submit Feedback