Tag
This article discusses the concept of 'Verifier Tax' in AI agent benchmarks, distinguishing between safe success (completing tasks without violating constraints) and unsafe success (completing tasks but violating constraints), and questions how to properly measure agent performance considering safety tradeoffs.