Quoting Andrew Kelley
Summary
Andrew Kelley, creator of Zig, argues that LLM-assisted contributions are detectable through distinct mistakes and a 'digital smell,' comparing it to smoking in a non-smoking house.
View Cached Full Text
Cached at: 05/08/26, 06:59 AM
Similar Articles
LLMs Can See the Smoke but not the Fire: Evaluating Abductive Reasoning with Elenchos
The paper introduces Elenchos, a generative evaluation framework for abductive reasoning in LLMs, where models must infer hidden rule changes from behavioral differences under black-box access. It finds a detection-attribution dissociation: models detect alterations but struggle to identify the specific mutations, especially under interacting mutations.
Zig president says AI coding contributions are 'invariably garbage,' so he banned them
Zig president Andrew Kelley banned AI-assisted code contributions, calling them 'invariably garbage' and a waste of reviewer time. The policy prohibits any LLM-generated, paraphrased, or AI-edited code in the open-source project.
The Illusion of Reasoning: Exposing Evasive Data Contamination in LLMs via Zero-CoT Truncation
This paper introduces Zero-CoT Probe (ZCP), a black-box detection method that identifies evasive data contamination in LLMs by truncating chain-of-thought reasoning and comparing performance on perturbed datasets, achieving robust detection of both direct and indirect contamination.
Distinguishing Artificial from Authentic: Evaluating LLMs for Detecting LLM-Generated Content
This paper investigates how well LLMs can detect their own generated content in educational contexts, finding that detection accuracy varies by task type and is unreliable for short-answer questions.
It's Not Just X. It's Y
This essay explores how LLMs' post-training (RLHF and RLVR) produces linguistic tics like negative parallelism, and critiques the use of AI detectors (Grammarly, Pangram) that force writers to sound like machines to avoid false accusations.