domain-scheduling

Tag

Cards List
#domain-scheduling

D^3-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation

Hugging Face Daily Papers · 2026-08-25 Cached

D³-MOPD is a zero-overhead scheduler for multi-teacher distillation that dynamically adjusts domain sampling ratios based on per-domain reverse-KL trajectories, improving convergence efficiency and closing most of the student-to-teacher performance gap.

0 favorites 0 likes
← Back to home

Submit Feedback