Tag
A study finds that reinforcement learning gains in transformers are concentrated in a single middle layer, and training just that layer can match or surpass full-parameter RL training across multiple models and tasks.