hallucination

WIRED reports that mainstream AI chatbots frequently deliver inaccurate, outdated, or partisan answers about the US midterms, with research showing nearly 40% of election responses contain factual errors and chatbots often cite 'pink slime' partisan sites.

Stanford researchers retested 50 widely cited findings about LLMs using 20 new models and found that 44% no longer held, 34% had significantly weakened, and only 16% still held, suggesting that LLM research findings may have a “shelf life” of only about 15 months.

A Wired guide on when AI chatbots like ChatGPT, Claude, and Gemini are reliable for web search versus when traditional search is safer, noting AI excels at basic lookups and complex multi-source queries but falters on obscure questions and can present confident answers from poor sources.

The paper introduces Bilal-Bench, a 240-question expert-verified Bengali benchmark for open-ended Islamic-source fabrication, evaluating seven open-weight models (1B–120B) and finding that six of seven confidently fabricate on 79.3–95.3% of source-production questions with no monotonic improvement from scale.

LlamaIndex released BooBench, a playful 179-page Halloween-themed benchmark that 'scares' LLMs and document OCR tools into repeating characters, exposing failure modes where VLMs enter repetition loops on real-world documents with repeated elements like fill leaders and redaction marks.

Trakkr Research tested 1,285 statistics cited by ChatGPT, Perplexity, Gemini, Claude, and Google AI Overviews, finding only 40% traced back to a study saying the same thing, while many 'zombie stats' circulate with no research behind them.

OA-RAG is an agentic framework that combines formal ontology-based reasoning with LLM reasoning to improve faithfulness in retrieval-augmented generation, reporting grounding levels (entailed, supported, related, unrelated) and achieving top performance on medical QA benchmarks derived from large-scale ontologies.

作者通过 Hugging Face 的 token 追踪数据反驳了 Cohere 关于 Qwen 3.8 Flash Next 向阿里远程 URL 上传数据的说法，指出该行为需要特定的 2,232-token 前缀才会触发，且在正常使用中几乎不可能遇到。

A practitioner ran a four-agent RAG panel experiment and documented three unexpected failure modes: irrelevant-but-supportive citations, agents citing their own generated notes, and fixed top-K retrieval forcing filler citations. The post shares fixes in progress and asks the community how they measure real RAG improvement.

norregel 是一个预注册基准，用于测试语言模型能否给出挪威法律中带日期的数值（金额、百分比、年龄限制等）。第二轮预注册实验显示模型对训练截止后生效的数值更易给出过时答案，但该效应在敏感性分析下并不稳健，且部分模型（如 Haiku 4.5）答案大多不可解读。

提出一种目标感知的幻觉压力测试筛选方法，通过迭代编辑源材料种子提示来暴露特定大模型的幻觉问题。实验显示编辑后的提示显著提升幻觉严重程度，但跨模型的提示级得分相关性很低，说明诊断价值具有模型特异性。

A comparative benchmark study evaluating ten LLMs on 70 academic prompts across four complexity levels, measuring hallucination and response deviation. Findings highlight a trade-off between response completeness and factual reliability, with Perplexity and DeepSeek V3 scoring highest on accuracy.

该论文评估了单一LLM基线与三种多智能体拓扑在临床任务中的表现，发现协作能提升任务指标，但并不必然降低幻觉，且模型本身而非拓扑结构决定了幻觉的变化方向。

作者观察到新一代大模型的幻觉问题已大幅减少，输出大多有据可依，并向社区提问 LLM 是否已经跨过了可靠性门槛。

The user complains that the Grok model suffers from severe hallucinations and keeps insisting on an incorrect guess about what NAM means despite repeated corrections. They believe the model’s poor quality makes the Grok bot unusable in serious contexts.

Qwen's 10-million-document RAG pipeline uses four lines of defense — hybrid retrieval, citation-constrained generation, claim-level verification, and calibrated abstention — to bring the hallucination rate on unanswerable questions down to 2%, while keeping p95 latency at 18ms. It's a production-grade anti-hallucination architecture worth studying.

A team shares how their self-hosted RAG support chatbot confidently blended two warranty policies and promised a customer a free repair, and compares options for catching such errors — tracing retrieved chunks with tools like Langfuse or Arize Phoenix, versus blocking unchecked answers with guardrails from Orq AI or NeMo Guardrails.

一项大规模研究分析了 DeepSeek、Qwen、豆包和元宝等中文生成式搜索助手的 160,860 条引用，发现近 40% 展示给用户的链接从未被实际用于生成回答，且约 13% 的答案中的品牌名称在引用页面中根本找不到来源。

提出 First-Token Cueing 行为探针，发现大模型许多闭卷事实问答错误源于无法生成正确的首 token，而仅提供该首 token 即可让模型完成并识别出正确答案，说明大量错误来自可恢复的首步解码失败而非知识缺失。

作者用本地 LLM + MCP 工具构建了一个 ERP 问答系统，并加入基于 Claude 的验证拦截器，使准确率达到 99% 以上；他讨论人们是否能容忍 AI 偶尔出错，并思考为何人类对 AI 错误的容忍度低于人工。