prefix-tuning

Tag

Cards List
#prefix-tuning

Max Out GRPO Signal: Adaptive Trace Prefix Control for Hard Reasoning Problems

arXiv cs.CL · 22h ago Cached

This paper introduces AdaPrefix-GRPO, a method that adaptively controls the length of correct solution prefixes provided to a model during GRPO training, maintaining a 50% success rate to maximize gradient signal. It significantly improves accuracy on hard math reasoning problems while reducing computational cost.

0 favorites 0 likes
← Back to home

Submit Feedback