sampled-token

Tag

Cards List
#sampled-token

Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation

Hugging Face Daily Papers ↗ · 2026-08-30 Cached

The paper introduces Influence-Directed Adaptive On-Policy Distillation (IDA-OPD) to solve the diversity bottleneck in sampled-token on-policy distillation, enhancing diversity transfer in reasoning models without full-vocabulary teacher data.

0 favorites 0 likes
← Back to home

Submit Feedback