perturbation-audits

Tag

Cards List
#perturbation-audits

Auditing the Audit: Five Failure Modes in Benchmark-Validity Audits

arXiv cs.LG · 2026-07-07 Cached

This paper identifies five failure modes in perturbation-based benchmark-validity audits used for AI governance, demonstrating that implementation details can silently manufacture conclusions. It proposes a due-diligence gate to improve the reliability of evaluation evidence.

0 favorites 0 likes
← Back to home

Submit Feedback