distillation-framework

Tag

Cards List
#distillation-framework

Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation

Hugging Face Daily Papers · 2026-08-19 Cached

The paper introduces Open-MOPD, a framework that diagnoses and fixes capability imbalance in multi-teacher on-policy distillation by balancing token-level budgets, improving headroom recovery from 35.6% to 83.4% through dynamic allocation and reward refresh.

0 favorites 0 likes
← Back to home

Submit Feedback