Tag
A developer benchmarks 32 local models on fact extraction for agent memory, showing that F1 hides a critical failure mode: models with similar scores differ greatly in how often they invent facts on inputs that should output nothing. The article argues agent memory evaluation must include empty-output and retraction cases.
This paper proposes a framework to elicit intrinsic hallucinations in LLMs using semantically equivalent adversarial perturbations, showing that state-of-the-art models degrade significantly in contextual faithfulness even with meaning-preserving query variations.
This paper introduces ACT-Eval, a tool-augmented evaluation framework for LLM chess commentary, and releases a benchmark of 325 position-move pairs. It finds that factual hallucinations remain pervasive in LLM chess commentary, and tool augmentation improves factual correctness but not expert-level strategic coverage.
Introduces factwash, an open-source write-time gate that deterministically catches AI rewrites that turn hearsay into fact by stripping attribution, hedging, or temporal context. The paper analyzes when simple checks suffice versus when an LLM witness is needed, and evaluates the approach on large annotated corpora.
A user shares that Google's AI Overview answerbot claimed it was made by OpenAI, highlighting a hallucination or misattribution in the AI system.
GeoArbiter proposes a training-free pipeline that selectively injects image-unverifiable geographic facts into remote-sensing multimodal LLMs to reduce knowledge hallucinations while preserving retrieval accuracy gains.
This paper proves that using error-penalized scoring rules with abstention as a discrete action can kill both the reward gradient and the KL anchor, causing models to collapse toward refusing everything. It proposes a structural repair — training a mandatory confidence report — and validates the mechanism with simulations and language model experiments.
This paper characterizes 'futile reasoning' in large language models, where models produce superficially valid but incorrect reasoning on tasks beyond their capability. They introduce CaRL, a capability-aligned reinforcement learning method that trains LLMs to abstain from futile reasoning while preserving performance.
This paper introduces the 'Agentic Formalism Trap' and an Evaluative Dissonance Index, showing how LLM-as-a-Judge systems can be misled by structural formalism and consensus mimicry rather than semantic truth, based on 22,500 trajectories across multiple domains.
Introduces AD-MCQ and DEFT-RLVR, a method for verifiable reasoning in autonomous driving VLMs that defers future trajectory exposure to post-decision verification, improving reasoning faithfulness while reducing hallucinations.
A personal AI benchmark asking models to generate an SVG of a frog with a Habsburg jaw reveals that the model adds elaborate editorializing, inventing royal status and medical commentary beyond the literal request.
Article 50 of the EU AI Act takes effect, requiring disclosure of AI-generated text on public-interest matters, with fines for non-compliance. The article highlights cases where consulting firms like PwC and Deloitte used hallucinated AI content and now face legal consequences.
An exploration of a strange prompt that causes Claude Opus 5 to hallucinate and reproduce content resembling leaked private chats between Anthropic users and employees, raising questions about training data and AI behavior.
A VP/PM with coding background shares hands-on experience using LLMs like Claude Opus and Fable, highlighting limitations in memory, hallucination, and originality while emphasizing the irreplaceable value of human intuition and domain expertise.
Discusses the difficulty of verifying outputs from autonomous agents after long-running tasks and asks about using critic agents or traceability tools to ensure trustworthiness.
An AI agent built a knowledge graph from a research paper it had never seen before, using self-verification techniques to reduce hallucinations.
Proposes three attention-guided strategies for layer selection in contrastive decoding for large language models, improving factuality on TruthfulQA over the DoLa baseline.
This paper proposes a novel online reinforcement learning method to improve factuality in reasoning LLMs by designing a reward function that balances factual precision, detail, and relevance, achieving a 23.1 percentage point reduction in hallucination rate on six benchmarks.
This paper presents the first systematic study of faithfulness in document-grounded podcast generation, introducing a turn-level LLM-as-a-judge evaluation framework and a model-agnostic catch-n-repair method that improves faithfulness across domains.
This study evaluates frontier and open-weight LLMs on IMO 2026 problems, demonstrating that specialized harnesses like AutoFyn significantly improve performance of sub-frontier models, though hallucination issues persist on the hardest problem.