generalization-failures

This paper proposes a method to construct language models that exhibit controllable generalization failures when trained with reinforcement learning, demonstrating that training success can diverge from generalization in structured ways.