validation-set

Tag

Cards List
#validation-set

Predicting Inference-Time Scaling Gains from Labeled Validation-Set Output Statistics

arXiv cs.CL · 2026-06-03 Cached

This paper introduces a method to predict best-of-N inference scaling gains for language models using cheap statistics from a single labeled validation-set sampling pass. A compact predictor with three core features achieves Spearman ρ=0.90 with actual gains, enabling screening of configurations before expensive reward-model scoring.

0 favorites 0 likes
← Back to home

Submit Feedback