Agents hallucinated because they were committed to the prompt: how RLHF broke Winograd and Flores's 1986 state machine (and the 1-line fix)
Summary
作者提出 LLM 幻觉源于 RLHF 强制模型在 Token 1 无条件承诺(Promise),导致生成过程中无法反悔只能编造 API;建议用 Winograd/Flores 对话行动状态机的『Zero-Shot Flores Handshake』显式授权模型先反问或拒绝,再生成代码。
Similar Articles
Why our AI agent prompt kept rotting into a 130-line legal contract, and how a 1986 speech-act state machine + 1977 4-valued logic let us delete the "Do NOT" rules
作者讲述了如何用 Flores & Winograd 的言语行为状态机、Belnap 四值逻辑和 CSP 通道前缀,把 AI agent 提示词里不断膨胀的 130 行防御性 'Do NOT' 规则,重构成可验证的状态迁移与 Makefile 依赖图,并向社区征集类似实践。
Hallucination as a Feature, not a Defect: Evaluating a multi-agent architecture to transform speculative language-model outputs into testable scientific hypotheses
This paper proposes a Rust-based multi-agent architecture that uses LLM hallucinations as a feature to generate and evaluate scientific hypotheses, comparing its performance against direct prompting and other methods.
The Hallucination Snowball: Modeling Error Propagation as State Transitions in Multi-Agent LLM Pipelines
This paper models hallucination propagation in multi-agent LLM pipelines as a Markov process, showing that errors become less detectable across stages and proposing early verification to reduce survival rates.
My agents kept lying nonstop so I made them show their work
The author describes building a 'gate' that logs tool calls and verifies that claims in an AI agent's answer correspond to actual log entries, forcing the agent to show its work and reducing hallucinated responses.
Closed-World Resolution Against Tool Hallucination in LLM Agents
This paper introduces a closed-world resolution method to combat tool hallucination in LLM agents, offering a taxonomy and benchmark for measuring and addressing fabricated tool calls.