Tag
A user shares concerns about AI models presenting thin or ambiguous data with the same confidence as well-supported findings, citing a case where a complaint appearing only twice in 200 comments was ranked as a top concern. The piece questions whether this is a fixable prompting issue or a fundamental limitation requiring manual verification.
The author shares experiments using a custom WebUI to let Gemma and Qwen models inspect their own logprobs to detect hallucinations. Initial observations suggest that first-recall token probabilities can indicate uncertainty, though both models struggle to read their own logprobs.
This paper presents a grounded and decomposed framework for evaluating relation-level hallucinations in abstractive summarization, introducing a normalized Relation Hallucination Index (RHI) with linguistically informed relation extraction enhancements.
This paper presents UniHall, a fine-grained hallucination benchmark with a unified taxonomy, and Self-Adaptive Multimodal Fuzzing (SAMF), a self-evolving stress-testing framework for multimodal LLMs. Experiments show SOTA models degrade significantly under fuzzing and reveal a helpfulness-hallucination trade-off.
This paper introduces REIN, an alignment framework that reduces hallucination in large reasoning models by training them to explicitly reflect before answering and to abstain when knowledge is insufficient. Experiments show consistent gains in selective accuracy and hallucination reduction across benchmarks.
A user reports that Claude's voice mode produced a suspicious tool-call result containing an apparent prompt-injection message claiming to be from Anthropic's security team, asking for access to sensitive files.
The article describes a technique for classifying e-commerce queries with LLMs by having the model hallucinate hypothetical classifications, then mapping them to the real taxonomy using embeddings, which is cheaper and simpler than constrained structured outputs.
A developer benchmarks 32 local models on fact extraction for agent memory, showing that F1 hides a critical failure mode: models with similar scores differ greatly in how often they invent facts on inputs that should output nothing. The article argues agent memory evaluation must include empty-output and retraction cases.
This paper proposes a framework to elicit intrinsic hallucinations in LLMs using semantically equivalent adversarial perturbations, showing that state-of-the-art models degrade significantly in contextual faithfulness even with meaning-preserving query variations.
This paper introduces ACT-Eval, a tool-augmented evaluation framework for LLM chess commentary, and releases a benchmark of 325 position-move pairs. It finds that factual hallucinations remain pervasive in LLM chess commentary, and tool augmentation improves factual correctness but not expert-level strategic coverage.
Introduces factwash, an open-source write-time gate that deterministically catches AI rewrites that turn hearsay into fact by stripping attribution, hedging, or temporal context. The paper analyzes when simple checks suffice versus when an LLM witness is needed, and evaluates the approach on large annotated corpora.
A user shares that Google's AI Overview answerbot claimed it was made by OpenAI, highlighting a hallucination or misattribution in the AI system.
GeoArbiter proposes a training-free pipeline that selectively injects image-unverifiable geographic facts into remote-sensing multimodal LLMs to reduce knowledge hallucinations while preserving retrieval accuracy gains.
This paper proves that using error-penalized scoring rules with abstention as a discrete action can kill both the reward gradient and the KL anchor, causing models to collapse toward refusing everything. It proposes a structural repair — training a mandatory confidence report — and validates the mechanism with simulations and language model experiments.
This paper characterizes 'futile reasoning' in large language models, where models produce superficially valid but incorrect reasoning on tasks beyond their capability. They introduce CaRL, a capability-aligned reinforcement learning method that trains LLMs to abstain from futile reasoning while preserving performance.
This paper introduces the 'Agentic Formalism Trap' and an Evaluative Dissonance Index, showing how LLM-as-a-Judge systems can be misled by structural formalism and consensus mimicry rather than semantic truth, based on 22,500 trajectories across multiple domains.
Introduces AD-MCQ and DEFT-RLVR, a method for verifiable reasoning in autonomous driving VLMs that defers future trajectory exposure to post-decision verification, improving reasoning faithfulness while reducing hallucinations.
A personal AI benchmark asking models to generate an SVG of a frog with a Habsburg jaw reveals that the model adds elaborate editorializing, inventing royal status and medical commentary beyond the literal request.
Article 50 of the EU AI Act takes effect, requiring disclosure of AI-generated text on public-interest matters, with fines for non-compliance. The article highlights cases where consulting firms like PwC and Deloitte used hallucinated AI content and now face legal consequences.
An exploration of a strange prompt that causes Claude Opus 5 to hallucinate and reproduce content resembling leaked private chats between Anthropic users and employees, raising questions about training data and AI behavior.