repeated-sampling

Tag

Cards List
#repeated-sampling

@omarsar0: Finally a good paper testing whether self-reflection loops are worth it. Setup: Seven methods, open models at 1.5B, 3B …

X AI KOLs Timeline ↗ · 2026-08-04 Cached

A paper finds that self-reflection loops like Self-Refine and Reflexion do not beat repeated sampling at equal token cost across open models from 1.5B to 7B, with all 18 self-inspection comparisons negative.

0 favorites 0 likes
#repeated-sampling

When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling

arXiv cs.LG ↗ · 2026-06-30 Cached

This paper identifies the 'modal ceiling' and 'correlation ceiling' in test-time scaling for reasoning models, showing that beyond a few dozen samples, additional sampling does not improve selection accuracy and can even harm it, highlighting the identifiability gap between generating and recognizing correct answers.

0 favorites 0 likes
← Back to home

Submit Feedback