executable-verifiers

Tag

Cards List
#executable-verifiers

VerifierBench: Benchmarking the Generation of Executable Verifiers for LLM Agents

Hugging Face Daily Papers ↗ · 2026-10-19 Cached

VerifierBench introduces a benchmark of 222 tasks and 4,993 hidden test cases to evaluate how well LLM agents generate executable verifiers, finding that verifiers tend to over-reject valid solutions due to hidden assumptions that survive self-testing.

0 favorites 0 likes
← Back to home

Submit Feedback