Top AI conference uses AI detector to reject papers for allegedly being written by AI
Summary
NeurIPS 2026 used a proprietary AI-text detector to desk-reject papers for alleged AI policy violations without validating it on the target distribution; the same detector later flagged conference chairs' own papers as likely AI-written.
Similar Articles
Why AI Detection Fails for Academic Integrity
This paper evaluates commercial AI detectors in academic settings, finding high false-positive rates on AI-assisted human writing and near-total evasion via humanizers, concluding detector scores should not be standalone misconduct evidence.
NeurIPS used uncalibrated AI detector for desk rejections [D]
A submission was desk-rejected from NeurIPS based on an uncalibrated AI detector (Pangram), raising concerns about circularity in the review process and unvalidated false-positive rates on the target distribution.
Policy-Conditioned AI-Use Detection: An Evidentiary Framework for Academic Publishing
The paper argues that standard AI-text detectors measure the wrong thing for academic venues and proposes policy-conditioned AI-use detection, an evidentiary framework that takes venue policies as explicit inputs, reports calibrated hypotheses and uncertainty instead of binary verdicts, and builds benchmarks from reproducible compliant/non-compliant workflow pipelines.
AI detectors simply don't work
An informal experiment testing multiple AI detectors found they produce inconsistent and unreliable results, flagging human-written essays as AI while sometimes missing actual AI-generated text. The author argues this unreliability is a serious problem for students and submitters whose work may be judged by these tools.
@rohanpaul_ai: The AI detector industry should be very uncomfortable reading this MIT report. The strongest institutional rejections y…
An MIT report strongly advises against relying on AI detectors, citing risks such as arms races with AI humanizers, false positives harming students, and unfair impacts on non-native English speakers and neurodivergent individuals.