entropy-guided-supervision

Tag

Cards List
#entropy-guided-supervision

SEAD: Competence-Aware On-Policy Distillation via Entropy-Guided Supervision

arXiv cs.CL · 2026-06-30 Cached

SEAD introduces a competence-aware on-policy distillation method that uses entropy to guide supervision at token, temporal, and prompt levels, achieving a +4.8 average accuracy improvement on OLMo-3 across six math benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback