f1-inflation

Tag

Cards List
#f1-inflation

Prompt Framing Distorts Count-Based Evaluation of LLM Error Detection: Evidence from Numeric Anchoring

arXiv cs.CL · 2026-07-03 Cached

This paper introduces ErrorBench, a stress-test protocol demonstrating that numeric anchoring in prompts inflates count-based F1 scores for LLM error detection without improving span localization, making count-only evaluation unreliable.

0 favorites 0 likes
← Back to home

Submit Feedback