mislabel-detection

Tag

Cards List
#mislabel-detection

Auditing LLM Benchmarks with Item Response Theory

arXiv cs.CL · 2026-06-01 Cached

This paper introduces an Item Response Theory-based method to detect mislabeled examples in LLM benchmarks at 95% precision, tracing errors to labeling heuristics and annotation issues.

0 favorites 0 likes
← Back to home

Submit Feedback