advantage-shaping

Tag

Cards List
#advantage-shaping

Process Advantage Signal Shaping: A Paradigm-Agnostic Middleware for Process-Supervised RL in LLM Reasoners

arXiv cs.AI · 2026-06-30 Cached

PASS is a middleware that fixes three pathologies in process-supervised RL for LLM reasoners, improving GRPO by independently standardizing streams, chunking by value, and using average value density. It shows consistent gains in math reasoning and multi-hop QA.

0 favorites 0 likes
← Back to home

Submit Feedback