I taught my 1B to follow instructions. It got worse at following instructions...

Reddit r/LocalLLaMA News

Summary

The author trained 1B, 2B, and 3B models with the same SFT recipe and observed that instruction-following (IFEval) regressed for the 1B and 2B models but improved for the 3B, possibly due to different learning rates or model capacity.

Same SFT recipe (SlimOrca 50K, LoRA r=16, 1 epoch). Three models trained from scratch at 1B, 2B, and 3B parameters. IFEval before and after: |Model|Base|After SFT|Delta| |:-|:-|:-|:-| |1B|20.50|14.75|**-5.75**| |2B|21.94|17.03|**-4.91**| |3B|23.14|25.18|**+2.04**| OK so SFT is supposed to teach instruction-following. thing is though the 1B actually unlearned it. 2B was slightly less bad. The 3B finally read the room. Setups were slightly different: 3B used lr=5e-5, the others used 2e-4. So maybe it's capacity, maybe it's the gentler LR. I'll re-run the 2B at 5e-5 to find out. Before I burn the compute: 1. Anyone else seen IFEval regress after SFT on small models? 2. Is this a known thing I missed? 3. Best guess on mechanism? Receipts available if anyone wants to dig in.
Original Article

Similar Articles

Shared SFT Lessons Across Alignment, Model Organisms, and Toy Models

arXiv cs.LG

This paper studies transferring lessons about supervised fine-tuning (SFT) across alignment training, model organisms, and toy models, showing that techniques like training on reasons for behavior and mixing on-model data can improve generalization and capability preservation.

@f14bertolotti: Stellar performance from a 3B model. These results were achieved primarily through post-training refinements on Qwen2.5…

X AI KOLs Timeline

This technical report introduces VibeThinker-3B, a 3B parameter model that achieves frontier-level verifiable reasoning performance through post-training refinements on Qwen2.5-Coder, including curriculum-based supervised fine-tuning, multi-domain reinforcement learning, and offline self-distillation, matching or exceeding much larger models like DeepSeek V3.2.

Improving instruction hierarchy in frontier LLMs

OpenAI Blog

OpenAI presents a training approach using instruction-hierarchy tasks to improve LLM safety and reliability by teaching models to properly prioritize instructions based on trust levels (system > developer > user > tool). The method addresses prompt-injection attacks and safety steerability through reinforcement learning with a new dataset called IH-Challenge.