AI detectors simply don't work
Summary
An informal experiment testing multiple AI detectors found they produce inconsistent and unreliable results, flagging human-written essays as AI while sometimes missing actual AI-generated text. The author argues this unreliability is a serious problem for students and submitters whose work may be judged by these tools.
Similar Articles
AI detectors are a bad idea
This article argues that AI detectors and watermarking are problematic because they dismiss human effort behind work and degrade AI-generated text quality.
AI detectors are creating a new era of distrust
This article examines the growing use of AI detectors in education and the resulting atmosphere of distrust, highlighting concerns about false positives and the subjective nature of AI-written text detection.
Why AI Detection Fails for Academic Integrity
This paper evaluates commercial AI detectors in academic settings, finding high false-positive rates on AI-assisted human writing and near-total evasion via humanizers, concluding detector scores should not be standalone misconduct evidence.
How accurate are AI checkers?
A writer questions the accuracy of AI detection tools after receiving wildly inconsistent results for her own human-written movie reviews, highlighting the unreliability of current AI checkers.
AI Detectors Can Find the Pattern. They Still Can’t Hear the Writer.
The article critiques AI detection tools for relying on surface-level patterns that can misidentify human writing, especially when polished, and highlights their failure to capture the unique voice of individual writers.