Tag
The paper demonstrates that recursive language models improve out-of-domain generalization by isolating subtasks, avoiding shortcuts used by standard Chain of Thought, and highlighting limitations in classical learning theory for true reasoning.
SALSA introduces a lightweight adaptation method for speech-aware LLMs that learns layer-wise steering vectors via supervised objective, achieving significant improvements (up to 46.8% relative) on out-of-domain speech benchmarks, and shows that steering the encoder layers is more effective than modifying the LLM backbone.
This paper introduces Rotation-Preserving Supervised Fine-Tuning (RPSFT), a method that improves out-of-domain generalization by preserving projected rotations in pretrained singular subspaces during fine-tuning.