Tag
The paper introduces ProClaim, a scientific agent that persists a structured evidence state outside the model context, and ProClaim-eval, a 718-claim consensus verification benchmark, showing that both the evidence state and a trained stopping judge improve consensus claim verification over baselines and general-purpose agent harnesses.
论文提出 Thinking-in-Bets,一种无需训练的方法,让 LLM 代理在读取用户反馈前先记录已验证的主张与置信度,从而在被挑战时减少错误反转和不必要的修改,同时保持准确性。
The paper evaluates Jev, a non-generative decision model, against a frontier LLM (gpt-6-astra) for RAG claim verification on 495 LLM-AggreFact claims, finding statistically indistinguishable headline accuracy at a 187-fold cost difference but highly unequal error profiles, and showing that a confidence-gated cascade can cut costs without beating a matched random-escalation control.
This paper studies how multimodal claim verification models respond to stylistic text changes induced by LLM rewriting. Evaluating 11 open-weight VLMs (2B–38B), the authors find accuracy is largely robust to natural rewriting and controlled LLM-word injection, though hedging-oriented modifications cause consistent probability shifts across nearly all models.
Peerify is a pipeline for automatically verifying peer-review claims against manuscript evidence, using a benchmark of 800 claims from NeurIPS 2024 and ICLR 2024, demonstrating that retrieval-centered verification outperforms entailment baselines.
OmniHallu introduces a unified hallucination detection framework for multimodal large language models, covering comprehension and generation tasks across image, video, and audio modalities, with a benchmark and multi-agent architecture.
CoVer is a factual adjudication framework for addressing evidence-level and aggregation-level conflicts in claim verification, with strong performance evaluated on the ContraNote dataset from X's Community Notes system.
CLAIR-Fin is an adversarial multi-agent framework designed to enhance faithfulness in cross-modal financial question answering by decomposing questions into atomic claims and using adaptive debate and verification to reduce hallucinations.
This paper introduces evidence-ledger adjudication, a workflow for claim-evidence traceability in AI-assisted writing, evaluated on a blind benchmark from AVeriTeC, CLIMATE-FEVER, and SciFact, showing agent-based methods outperform baselines.
This paper introduces intra-paper claim verification, a framework that uses LLMs to evaluate whether novelty claims in a paper are supported by its methodological evidence, addressing a gap in existing automated peer review systems. Human evaluation shows significant alignment with human reviewer concerns, especially for novelty-related issues.
作者发布了ISNAD框架,借鉴约1400年历史的伊斯兰学术验证方法论,为多智能体AI链中的每个传递者打分,以验证AI生成言论的真实性和独立佐证。
This paper introduces Tree of Evidence (ToE), a hierarchical and explainable claim verification framework that dynamically retrieves and aggregates multi-source evidence using reinforcement learning. Experiments show 4-24 percentage point improvements over baselines, especially against adversarially poisoned inputs from Generative Engine Optimization.
Fine-tuning small LLMs (3B-7B) with QLoRA on biomedical claim verification achieves higher F1 than GPT-4o and GPT-5 at 44.5x lower cost, and reveals a structural artifact in SciFact. The study demonstrates robust cross-domain transfer when training on structurally sound data.
MoCA-Agent is a market-of-claims code agent that improves financial and numerical reasoning by decomposing questions into atomic claims and using specialist agents to buy/sell those claims, achieving strong results on multiple benchmarks using a fixed Qwen 3.6-27B backbone.
This paper introduces MAD2, a new benchmark for multimodal claim verification in spoken dialogues, and proposes a calibrated fusion of audio and text models that leverages conversational context to improve verification accuracy.
This paper introduces PrimeFacts, a methodology and resource for extracting fine-grained evidence from fact-checking articles using large language models. The extracted premises improve evidence retrieval and claim verification performance by up to 30% in MRR and 10-20 points in Macro-F1.