benchmark-cleaning

Tag

Cards List
#benchmark-cleaning

Judging by the Cover: Cleaning LLM Truthfulness Benchmarks to Avoid Surface-Level Feature Leakage

arXiv cs.CL ↗ · 2026-09-14 Cached

This paper identifies surface-level feature leakage in truthfulness benchmarks like TruthfulQA, where models can cheat by exploiting answer form differences, and introduces Audit-Prune to clean benchmarks, ensuring more reliable evaluations.

0 favorites 0 likes
← Back to home

Submit Feedback