manifold-drift

Tag

Cards List
#manifold-drift

Manifold Drift in Flow Preference Optimization: A Root Cause of Reward Hacking

arXiv cs.AI ↗ · 2026-08-21 Cached

The paper identifies manifold drift as a root cause of reward hacking in flow preference optimization and introduces ThermoDPO, a temperature-controlled method that anchors optimization on preferred samples to preserve data manifold integrity and improve performance.

0 favorites 0 likes
← Back to home

Submit Feedback