Tag
This paper finds that 82% of the reported out-of-domain multiple-choice gains from RLVR on four 7B SimpleRL model pairs are artifacts of answer extractors that only read \boxed{} answers, meaning RL mostly teaches models to place answers in the box rather than improving actual reasoning.