@huggingface: Training Agents 2: Live tutorial on model distillation for training custom agents.
Summary
Hugging Face hosted a live tutorial on model distillation for training custom agents, available as a replay.
View Cached Full Text
Cached at: 07/07/26, 07:36 PM
Training Agents 2: Live tutorial on model distillation for training custom agents. https://t.co/tRqwLuQNDm
Hugging Face
Source: https://x.com/i/broadcasts/1XxyggpEQALGM
Training Agents 2: Live tutorial on model distillation for training custom agents.
REPLAYDon’t miss what’s happening
People on X are the first to know.
Similar Articles
@ben_burtenshaw: before model distillation was an attack vector. it was. pretty handy way of improving model performance on a task you c…
Ben Burtenshaw announces a live stream on July 7th covering knowledge distillation in post-training, showing how to implement it using small models to approach large model performance.
@SergioPaniego: before model distillation was an attack vector. it was. pretty handy way of improving model performance on a task you c…
The article provides a brief history of model distillation in AI and announces an upcoming live stream class on distilling open models using TRL (Transformer Reinforcement Learning).
@zhaisf: These were some magical results from distillation by @geoffreyhinton that really shocked me when I first saw them, and …
The article discusses surprising robustness of model distillation with respect to training distribution, even with little overlap with target distribution, and its implications for on/off-policy distillation.
Training Agents: Live tutorial on how to fine-tune a coding agent for continual learning
This live tutorial demonstrates how to fine-tune a small code agent (Gemma 4 2B) on an agent trace dataset using supervised fine-tuning (SFT), and automate hyperparameter sweeps and evaluation using HF Jobs and Track IO, embodying the concept of "using agents to train agents."
@athleticKoder: https://x.com/athleticKoder/status/2057091692235481560
A technical blog post that explains how to build agent training systems from first principles using a text-to-diagram agent as an example, covering environment definition, teacher trajectory generation, student fine-tuning, and reinforcement learning.