hallucination

An exploration of a strange prompt that causes Claude Opus 5 to hallucinate and reproduce content resembling leaked private chats between Anthropic users and employees, raising questions about training data and AI behavior.

A VP/PM with coding background shares hands-on experience using LLMs like Claude Opus and Fable, highlighting limitations in memory, hallucination, and originality while emphasizing the irreplaceable value of human intuition and domain expertise.

Discusses the difficulty of verifying outputs from autonomous agents after long-running tasks and asks about using critic agents or traceability tools to ensure trustworthiness.

An AI agent built a knowledge graph from a research paper it had never seen before, using self-verification techniques to reduce hallucinations.

Proposes three attention-guided strategies for layer selection in contrastive decoding for large language models, improving factuality on TruthfulQA over the DoLa baseline.

This paper proposes a novel online reinforcement learning method to improve factuality in reasoning LLMs by designing a reward function that balances factual precision, detail, and relevance, achieving a 23.1 percentage point reduction in hallucination rate on six benchmarks.

This paper presents the first systematic study of faithfulness in document-grounded podcast generation, introducing a turn-level LLM-as-a-judge evaluation framework and a model-agnostic catch-n-repair method that improves faithfulness across domains.

This study evaluates frontier and open-weight LLMs on IMO 2026 problems, demonstrating that specialized harnesses like AutoFyn significantly improve performance of sub-frontier models, though hallucination issues persist on the hardest problem.

Anthropic's Opus 5 shows non-monotonic performance on coding tasks; the 'high' effort setting outperforms 'max' due to unnecessary refactors. The model also has a 6% higher hallucination rate than Opus 4.8, and safety classifiers may silently fall back to the older model.

A developer shares how grounding an agent to a knowledge base with retrieval discipline, rather than a better model, solved hallucinations in automated slide generation. The approach splits retrieval from writing and enforces source checking before rendering.

A study showing that language models hallucinate when required to fill structured fields like JSON, even when they would honestly abstain in free text. The PhantomFill benchmark measures coerced fabrication rates.

This paper introduces a reproducible framework to measure ideological drift in LLM-generated answers to political questions by analyzing hallucinations. It finds that hallucinated content exhibits a robust leftward bias, even when sourced from right-leaning news articles, and links this to high-uncertainty generation contexts.

This paper presents the first rigorous study of how LLM watermarking schemes affect medical performance, evaluating five watermarks across multiple LLMs and VLMs on clinical reasoning tasks. The authors find that watermarks can cause degradation in medical text quality, including hallucinations and lexical corruption, which are masked by general-domain benchmarks.

Joseph Decker evaluates 16 AI models on truthfulness for his product Condensr, discovers that the leaderboard winner fabricated content five times in an audit, and instead ships the second-place model which had zero fabrications. The post details the evaluation process, a bug in the LLM judge that penalized accurate summaries due to truncated transcripts, and the importance of custom evals over generic benchmarks.

A solo founder running 16 AI agents orchestrated via Paperclip shares what broke and worked, including hallucinated feature promises mitigated by a QA agent, and code-level enforcement replacing prompt rules.

This paper investigates how format, instruction count, and context length affect instruction adherence and hallucination in LLMs through controlled experiments on a synthetic corpus, finding that instruction-following collapses beyond 80 rules regardless of format, and recall degrades sharply after 64-128k tokens with format-dependent effects. It releases the VeyraBench harness for reproduction.

SAAG proposes a cascaded diagnostic framework for evaluating LLM agent function calling by decomposing evaluation into registry conformance, structural completeness, and argument grounding stages, enabling interpretable diagnostics and iterative self-repair. Experiments with sub-4B models show improved argument precision and reduced value hallucination compared to single-pass evaluation.

This paper discovers that larger language models have a hidden auto-regressive risk regime where they commit to low-probability tokens and then snowball errors, causing reliability to degrade faster with scale. It shows that this failure mode is causal, dominant, and invisible to the model's own self-monitoring.

Evaluation of Laguna-S-2.1 against Qwen3.5-122B on RTX Pro 6000 shows it is the fastest 100B+ model tested and best at tool calling, but prone to inventing facts under pressure.

Proposes HALO, an architecture with six layers of defense to contain hallucination in enterprise AI systems, reframing 'zero hallucination' as a system-enforced property rather than a model property.