Tag
This paper presents efficient methods for benchmarking production LLM agents, demonstrating that adaptive testing based on item response theory can reduce evaluation costs while maintaining accuracy, with practical deployment insights for recurring assessments.
This paper explores efficient recurring evaluation methods for production LLM agents, comparing techniques like adaptive testing and fixed subsets, and provides practical recommendations for deployment.