hallucination-detection

Tag

Cards List
#hallucination-detection

CHORD: Cross-Model Hallucination Detection via Relational Graph Discrimination

arXiv cs.AI ↗ · 2026-10-31 Cached

CHORD提出了一种跨模型幻觉检测(CMHD)框架,将LLM隐藏状态表示为层级-词元-特征关系图,通过关系感知注意力与元学习获得可迁移到未见目标模型的检测信号,在跨模型泛化上优于现有检测方法。

0 favorites 0 likes
#hallucination-detection

Decision Models as Judges for Hallucination Detection

arXiv cs.CL ↗ · 2026-10-28 Cached

该论文构建了涵盖五种幻觉类型的二元基准(来自六个数据集的9,852个样本),比较了五种决策模型与生成式裁判gpt-6-sol在幻觉检测上的表现,发现决策模型在部分类型上以1-3%的成本匹敌或超越生成式裁判,但在逻辑与指令不一致类型上仍有差距且概率存在过度自信问题。

0 favorites 0 likes
#hallucination-detection

LLM Hallucination Detection via Low-rank Multilinear Decomposition

arXiv cs.CL ↗ · 2026-10-28 Cached

提出LOTUS框架,通过低秩多线性分解从LLM隐藏状态中提取紧凑表示以检测幻觉,在多个LLM和问答基准上超越现有最先进方法。

0 favorites 0 likes
#hallucination-detection

Mycelium: A Meta-Study of Hallucination Detection Across Provenance, Typology, and Granularities

arXiv cs.CL ↗ · 2026-10-27 Cached

Mycelium 是一项关于 LLM 幻觉检测的元研究,沿 provenance、typology 和 granularity 三个轴组织现有基准,分析基准构建与评估选择如何影响检测任务,并提出 Span Coverage F1 作为补充的跨度级评估指标。

0 favorites 0 likes
#hallucination-detection

Adaptive Transfer of Representational Signatures for LLM Reliability Detection

arXiv cs.CL ↗ · 2026-10-27 Cached

提出了一个跨域迁移表示特征的统计框架,用于检测 LLM 的幻觉与推理错误,在新域仅需 25 条标注样本即可将幻觉检测 AUROC 提升 6.8%、推理步骤预测 AUROC 提升 8.4%。

0 favorites 0 likes
#hallucination-detection

SOPO: Socratic Guided Policy Optimization for Span-Level Hallucination Detection

arXiv cs.CL ↗ · 2026-10-26

SOPO(Socratic Guided Policy Optimization)提出了一种多轮强化学习框架,通过苏格拉底式教师引导反馈和基于轮次的优势缩放来解决span级幻觉检测中的奖励稀疏与长度膨胀问题,在RAGTruth上取得SOTA,超越GPT-5等模型并开源了1.7B和4B模型。

0 favorites 0 likes
#hallucination-detection

Supervising the Visible State: Separating Representation from View Selection in Streaming Video

Hugging Face Daily Papers ↗ · 2026-10-26 Cached

This paper introduces Visible-State Supervision (ViSS) and Test-Time Causal View Search (TVS) to separate representation learning from evidence selection in streaming video understanding, achieving state-of-the-art accuracy on StreamingBench and OVO-Bench with far fewer processed frames.

0 favorites 0 likes
#hallucination-detection

Mycelium: A Meta-Study of Hallucination Detection Across Provenance, Typology, and Granularities

Hugging Face Daily Papers ↗ · 2026-10-24 Cached

A meta-study analyzing hallucination detection as a benchmark-conditioned measurement problem across provenance, typology, and granularity axes, proposing a Span Coverage F1 metric to address variability in span-level annotation boundaries.

0 favorites 0 likes
#hallucination-detection

Detecting Errors in Large Language Model Responses: The Incremental Predictive Value of Hidden States

arXiv cs.CL ↗ · 2026-10-21 Cached

该论文研究在已有输出侧信号的基础上,加入 LLM 隐藏状态对错误检测的增量预测价值,发现其在开放生成和多选任务上分别带来约 0.004 和 0.039 的 AUROC 提升,表明隐藏状态有额外信息但增益有限。

0 favorites 0 likes
#hallucination-detection

SHAM-Bench: A Span-level Hallucination Benchmark Across Multiple Tasks

arXiv cs.CL ↗ · 2026-10-21 Cached

The paper introduces SHAM-Bench, a unified span-level hallucination detection benchmark aggregating 6,461 human-annotated examples across six NLG tasks under a common schema and evaluation protocol. It finds that fine-tuned detectors degrade under distribution shift while prompt-based reasoning methods generalize better, and releases the dataset, code, and a public leaderboard.

0 favorites 0 likes
#hallucination-detection

Bengali Hallucination Detection with Retrieval and Programs: A System Study

arXiv cs.CL ↗ · 2026-10-19 Cached

本文介绍并审计了一个针对 Bengali 幻觉检测挑战赛(Olikbochon)的推理系统,该系统结合响应条件化查询重写、混合检索与任务特化的语言模型裁决,实现了 0.956 的私有宏 F1,同时指出语料重叠与运行不可复现性限制了其泛化性声明。

0 favorites 0 likes
#hallucination-detection

Measuring Mechanistic Uncertainty in Large Language Models via Causal Robustness

arXiv cs.CL ↗ · 2026-10-19 Cached

该论文提出"机制不确定性"概念,通过因果稳健性边际(causal robustness margin)量化大语言模型内部机制的稳定性,在多个开源模型与问答数据集上验证其对幻觉与不确定性检测的补充作用。

0 favorites 0 likes
#hallucination-detection

When Does Uncertainty Measure RAG Hallucination Risk?

arXiv cs.CL ↗ · 2026-10-19 Cached

该论文研究不确定性度量何时能有效衡量 RAG 幻觉风险,发现当检索证据充分约束答案时,困惑度能达到 0.81–0.91 AUROC,而检索覆盖不足时同一指标会失效,提出不确定性是条件性的幻觉风险度量。

0 favorites 0 likes
#hallucination-detection

LEMON: Equivariant Learning over Attention Maps for Zero-Shot Misbehavior Monitoring on New LLMs

arXiv cs.AI ↗ · 2026-10-19 Cached

LEMON is a graph neural network monitor that uses equivariant learning over attention maps to detect LLM misbehavior zero-shot across unseen models, outperforming baselines by up to 14 ROC-AUC points on hallucination and jailbreak monitoring across 16 LLMs and six datasets.

0 favorites 0 likes
#hallucination-detection

Measuring Mechanistic Uncertainty in Large Language Models via Causal Robustness

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

This paper introduces mechanistic uncertainty in LLMs, defined via a causal robustness margin measured using concept steering vectors, and shows that incorrect responses are more sensitive to internal interventions while learned facts gain robustness.

0 favorites 0 likes
#hallucination-detection

Does Location Matter? A Black-Box Causal Audit Reveals Model-Dependent Audio Grounding in LALM Hallucination

arXiv cs.AI ↗ · 2026-10-12 Cached

该论文提出一种黑盒因果审计方法,通过 CLAP 定位证据区域并用频谱门控进行局部消融,检测大型音频语言模型(LALM)的幻觉,发现音频接地行为具有模型依赖性,且提出的方法在解码时优于现有 Audio-Aware Decoding 基线。

0 favorites 0 likes
#hallucination-detection

HIVE: Open Source Research Tool w/ Confidence

Reddit r/AI_Agents ↗ · 2026-10-09

HIVE (Hive Inspired Virtual Entity) 是一个开源研究系统,通过九个从不同角度分析的 forager agent、一个 queen verdict 以及共享记忆(comb),并利用 Unpaywall 与 DOI 检索的已验证白皮书,为 LLM 输出提供可信度置信值,减少幻觉。系统可在本地运行(Ollama + Qwen3.6 35B),在 M1 Max 64GB 上设计与测试。

0 favorites 0 likes
#hallucination-detection

Fact over Fiction: Detection of Pathological Hallucinations in Sinhala-to-English Neural Machine Translation

arXiv cs.CL ↗ · 2026-10-09 Cached

This paper introduces a reference-free hallucination detection framework for low-resource Sinhala-to-English neural machine translation, presenting a 45,000-sample synthetic corruption dataset and fine-tuning mDeBERTa-v3 to achieve a token-level F1 of 0.841, benchmarked across eight NMT systems.

0 favorites 0 likes
#hallucination-detection

When Citations Mislead? A Claim-Level Benchmark for Legal Hallucination Detection

arXiv cs.CL ↗ · 2026-10-09 Cached

The paper introduces PARCEL, a claim-level benchmark for detecting legal hallucinations in LLM output, using 3,396 parenthetical-style claims from New York State Court of Appeals decisions framed as three-way NLI. State-of-the-art LLMs reach up to 0.97 accuracy zero-shot but still mislabel unsupported claims as supported, especially with fabricated yet plausible citations.

0 favorites 0 likes
#hallucination-detection

Detecting hallucinations in local models without eating VRAM: What we learned testing 1.5B to 120B models

Reddit r/LocalLLaMA ↗ · 2026-10-02

The post benchmarks a zero-GPU, CPU-only string-normalization entropy metric (Spanda) against semantic entropy across 1.5B–120B local and frontier models, finding that 7B–27B models are well-served by cheap exact-match entropy while 120B models collapse into identical confident hallucinations that even NLI models miss.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback