Tag
A tweet by John Schulman highlights the paper 'Chunky Post-Training,' which argues that diverse post-training datasets cause models to learn spurious correlations that lead to unintended behaviors, such as rejecting true facts posed in specific formats. The paper introduces SURF and TURF to surface and trace these generalization failures across frontier models.