Tag
An author shares an audit of their AI fact-checker's citations, discovering that about 1 in 18 were dead or fabricated, and provides practical fixes to improve reliability in AI systems.
This paper evaluates large language models' ability to verify citation support in legal documents, finding that while models detect wrong-case citations effectively, they struggle with pinpoint page references, often confusing topical relevance with precise support.
Chamber is a local-first CLI that prevents AI citation fabrication by never exposing document IDs to the model, then verifies cited passages via hashing. It supports any OpenAI-compatible endpoint and runs without config, database, or network.
This paper benchmarks 8 LLM judges for citation quality in deep-research systems, finding that cheaper models remain competitive with frontier models on source relevance and factual support, but differ in directional bias which matters for RL training.
Academic Research Skills is the first installable Claude Code workflow that packages a multi-agent pipeline to detect and prevent hallucinated citations in academic papers, addressing a problem where 146,932 hallucinated citations were counted in 2025 preprints.