Tag
The paper introduces Active Taskless Distillation (ATD), a method that transfers capabilities from a teacher model to a student model using only single-word responses on task-unrelated prompts, probing the behavioral shadows of post-training.