abstention-evaluation

This paper shows that using incomplete relevance judgments as a shortcut for scoring abstention in conversational RAG benchmarks systematically distorts evaluation: stronger retrievers yield more 'false miss' contexts that still contain answers, badly deflating answerability AUROC. The authors release code, runs, and labels and recommend scoring refusals against content-based labels instead of gold-document presence.