harness-evolution

Tag

Cards List
#harness-evolution

Rethinking the Evaluation of Harness Evolution for Agents

arXiv cs.AI · 2d ago Cached

This paper re-evaluates the methodology of automatic harness evolution for LLM agents, highlighting that its gains may stem from additional test-time search rather than improved harness design, and that evaluation on the same benchmark risks overfitting. Experiments show that harness evolution does not consistently outperform simpler test-time scaling methods.

0 favorites 0 likes
← Back to home

Submit Feedback