claim-verification

Tag

Cards List
#claim-verification

Does Recursive Knowledge Construction Help Agents Verify Consensus Claims in Science?

arXiv cs.AI ↗ · 2026-11-02 Cached

The paper introduces ProClaim, a scientific agent that persists a structured evidence state outside the model context, and ProClaim-eval, a 718-claim consensus verification benchmark, showing that both the evidence state and a trained stopping judge improve consensus claim verification over baselines and general-purpose agent harnesses.

0 favorites 0 likes
#claim-verification

Thinking-in-Bets at Test Time Reduces Sycophantic Revisions in LLM Agents

Hugging Face Daily Papers ↗ · 2026-10-26 Cached

论文提出 Thinking-in-Bets,一种无需训练的方法,让 LLM 代理在读取用户反馈前先记录已验证的主张与置信度,从而在被挑战时减少错误反转和不必要的修改,同时保持准确性。

0 favorites 0 likes
#claim-verification

Jev-as-a-Judge for RAG Claim Verification: Confidence-Gated Cascading Between a Non-Generative Verifier and a Frontier LLM

arXiv cs.CL ↗ · 2026-10-16 Cached

The paper evaluates Jev, a non-generative decision model, against a frontier LLM (gpt-6-astra) for RAG claim verification on 495 LLM-AggreFact claims, finding statistically indistinguishable headline accuracy at a 187-fold cost difference but highly unequal error profiles, and showing that a confidence-gated cascade can cut costs without beating a matched random-escalation control.

0 favorites 0 likes
#claim-verification

How Robust Is Multimodal Claim Verification to LLM Rewriting?

arXiv cs.CL ↗ · 2026-10-05 Cached

This paper studies how multimodal claim verification models respond to stylistic text changes induced by LLM rewriting. Evaluating 11 open-weight VLMs (2B–38B), the authors find accuracy is largely robust to natural rewriting and controlled LLM-word injection, though hedging-oriented modifications cause consistent probability shifts across nearly all models.

0 favorites 0 likes
#claim-verification

Peerify: Benchmarking Peer-Review Claim Verification

arXiv cs.CL ↗ · 2026-09-23 Cached

Peerify is a pipeline for automatically verifying peer-review claims against manuscript evidence, using a benchmark of 800 claims from NeurIPS 2024 and ICLR 2024, demonstrating that retrieval-centered verification outperforms entailment baselines.

0 favorites 0 likes
#claim-verification

OmniHallu: Unified Hallucination Detection for Cross-Modal Comprehension and Generation in Multimodal Large Language Models

arXiv cs.CL ↗ · 2026-09-11 Cached

OmniHallu introduces a unified hallucination detection framework for multimodal large language models, covering comprehension and generation tasks across image, video, and audio modalities, with a benchmark and multi-agent architecture.

0 favorites 0 likes
#claim-verification

CoVer: Conflict-Aware Claim Verification

arXiv cs.AI ↗ · 2026-09-02 Cached

CoVer is a factual adjudication framework for addressing evidence-level and aggregation-level conflicts in claim verification, with strong performance evaluated on the ContraNote dataset from X's Community Notes system.

0 favorites 0 likes
#claim-verification

CLAIR-Fin: An Adversarial Multi-Agent Framework for Claim-Level Verification and Adaptive Debate in Cross-Modal Financial QA

arXiv cs.CL ↗ · 2026-08-17 Cached

CLAIR-Fin is an adversarial multi-agent framework designed to enhance faithfulness in cross-modal financial question answering by decomposing questions into atomic claims and using adaptive debate and verification to reduce hallucinations.

0 favorites 0 likes
#claim-verification

Evidence-Ledger Adjudication for Claim-Evidence Traceability

arXiv cs.AI ↗ · 2026-07-31 Cached

This paper introduces evidence-ledger adjudication, a workflow for claim-evidence traceability in AI-assisted writing, evaluated on a blind benchmark from AVeriTeC, CLIMATE-FEVER, and SciFact, showing agent-based methods outperform baselines.

0 favorites 0 likes
#claim-verification

Do Methods Support the Claims? Intra-Paper Verification for Peer Review

arXiv cs.CL ↗ · 2026-07-30 Cached

This paper introduces intra-paper claim verification, a framework that uses LLMs to evaluate whether novelty claims in a paper are supported by its methodological evidence, addressing a gap in existing automated peer review systems. Human evaluation shows significant alignment with human reviewer concerns, especially for novelty-related issues.

0 favorites 0 likes
#claim-verification

Everyone verifies the agent. Almost no one verifies the claim. I built a trust layer that grades every transmitter in a multi-agent chain

Reddit r/AI_Agents ↗ · 2026-07-29

作者发布了ISNAD框架,借鉴约1400年历史的伊斯兰学术验证方法论,为多智能体AI链中的每个传递者打分,以验证AI生成言论的真实性和独立佐证。

0 favorites 0 likes
#claim-verification

ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation

arXiv cs.AI ↗ · 2026-06-29 Cached

This paper introduces Tree of Evidence (ToE), a hierarchical and explainable claim verification framework that dynamically retrieves and aggregates multi-source evidence using reinforcement learning. Experiments show 4-24 percentage point improvements over baselines, especially against adversarially poisoned inputs from Generative Engine Optimization.

0 favorites 0 likes
#claim-verification

Small LLMs for Biomedical Claim Verification: Cost-Effective Fine-Tuning, Structural Dataset Shortcuts, and Cross-Domain Generalization

arXiv cs.CL ↗ · 2026-06-12 Cached

Fine-tuning small LLMs (3B-7B) with QLoRA on biomedical claim verification achieves higher F1 than GPT-4o and GPT-5 at 44.5x lower cost, and reveals a structural artifact in SciFact. The study demonstrates robust cross-domain transfer when training on structurally sound data.

0 favorites 0 likes
#claim-verification

MoCA-Agent: A Market-of-Claims Code Agent for Financial and Numerical Reasoning

arXiv cs.AI ↗ · 2026-06-11 Cached

MoCA-Agent is a market-of-claims code agent that improves financial and numerical reasoning by decomposing questions into atomic claims and using specialist agents to buy/sell those claims, achieving strong results on multiple benchmarks using a fixed Qwen 3.6-27B backbone.

0 favorites 0 likes
#claim-verification

Context-Aware Multimodal Claim Verification in Spoken Dialogues

arXiv cs.CL ↗ · 2026-06-11 Cached

This paper introduces MAD2, a new benchmark for multimodal claim verification in spoken dialogues, and proposes a calibrated fusion of audio and text models that leverages conversational context to improve verification accuracy.

0 favorites 0 likes
#claim-verification

From Articles to Premises: Building PrimeFacts, an Extraction Methodology and Resource for Fact-Checking Evidence

arXiv cs.CL ↗ · 2026-05-08 Cached

This paper introduces PrimeFacts, a methodology and resource for extracting fine-grained evidence from fact-checking articles using large language models. The extracted premises improve evidence retrieval and claim verification performance by up to 30% in MRR and 10-20 points in Macro-F1.

0 favorites 0 likes
← Back to home

Submit Feedback