Tag
PopUpFactCheck.com improved its fact-checking quality by switching the underlying GPT-OSS-120B model to high reasoning effort, enhancing performance on attribution and judgment tasks while using caching and cost-effective routing to manage expenses.
This paper introduces Arafa, a large-scale Arabic fact-checking dataset generated using LLMs, aimed at addressing the scarcity of resources for automatic fact-checking in Arabic.
Andy Matuschak shares an experiment with programmable highlighters that automate citation finding, fact-checking, and interaction with AI agents.
DARE is a dialectical agentic reasoning framework for structured knowledge fact checking that uses an iterative retrieve–reason–reflect process, achieving 88.12% accuracy with an 8B model and matching GPT-4o performance.
The article presents R2VC, a modular fact-checking system that combines retrieval, verification, and confidence calibration to improve accuracy and reliability in automated fact checking, achieving a 13.74% accuracy increase on the FEVER benchmark.
This paper introduces a collaborative writing framework for personalized and reliable popular science writing, featuring a new dataset, benchmark, and multi-agent fact-checking mechanism that achieves state-of-the-art performance.
Chalked for Mac is a productivity tool that prepares replies based on live calendar and sourced facts, allowing users to insert them with the Tab key.
Full Fact's analysis shows AI chatbots like ChatGPT, Gemini, and Grok frequently generate misinformation when responding to false claims, including about AI-generated images and wars, highlighting their unreliability for fact-checking.
An audit of Perplexity's AI search models found that over a third of citations for specific figures do not contain those numbers on the linked pages, with failures including inaccessible or irrelevant sources.
CoVer is a factual adjudication framework for addressing evidence-level and aggregation-level conflicts in claim verification, with strong performance evaluated on the ContraNote dataset from X's Community Notes system.
Built an open-source fact-checker for AI agents that verifies claims by fetching real-time sources and providing truth and confidence scores, useful for both public and internal documents.
The article describes a type of AI hallucination where claims are accurate but quotations are fabricated, evading standard fact-checking, and discusses implementation challenges in detecting such errors.
ElementCheck is a complexity-aware framework that improves long-form text factuality evaluation by extracting sentence elements and organizing them into an element graph, accompanied by the new benchmark FastFact-Sent for enhanced verification accuracy.
This paper introduces BioCheck Agent, an LLM-based agent that generates structured biomedical fact-checking reports using RL-enhanced agentic search, showing improved accuracy and reduced hallucinations compared to base models.
A user tested ChatGPT, Claude, and Gemini in a group chat for mutual fact-checking to catch hallucinations, and invites Reddit to provide challenging prompts to find shared blind spots.
The paper introduces NepOOC, the first public Nepali-dominant multilingual benchmark for out-of-context misinformation detection, and evaluates multimodal architectures, finding that text-only models achieve strong performance.
Research shows that large language models' ability to confirm user beliefs depends on phrasing, with accuracy varying across epistemic expressions due to task confusion where models default to fact-checking.
This paper introduces a task for hallucination span detection in LLMs by aligning output tokens with input evidence, proposing an encoder-based model that uses prediction confidence to detect hallucinations without manual alignments.
ReflectFact is a self-reflective agent framework for multi-hop fact verification that addresses objective and knowledge conflicts via reasoning path planning, evidence-drift verification, and reasoning reflection, achieving state-of-the-art results on HOVER and EX-FEVER.
This paper identifies and characterizes Decomposition-Induced Context-Memory Conflict (DI-CC), a failure mode in decompose-then-verify pipelines where decomposition substitutes the model's parametric beliefs for the source text. The authors show it is mechanistically related to classical context-memory conflict, that SelfCheckGPT fails to detect it, and that context-aware decoding suppresses it but introduces severe parsing failures.