Tag
GEOALIGN, from the Alibaba team behind Qwen, identifies that instability in RL for LLMs often stems from a few bad rollouts causing conflicting update directions, and proposes a lightweight method to curate rollouts based on directional consistency, improving training stability and performance.