Tag
This paper introduces Teacher-Gated On-Policy Distillation (TGOPD), a method that verifies teacher reliability at the prompt level to improve on-policy distillation, leading to better performance and increased GPU utilization in asynchronous setups.