Local LLM for legal-document adaptation keeps hallucinating citations with total confidence — grounding/model/pipeline ideas?
Summary
A user reports that a local LLM hallucinates citations with high confidence when adapted for legal documents, and seeks advice on grounding, model, or pipeline ideas to mitigate this issue.
Similar Articles
Do Benchmarks Underestimate LLM Performance? Evaluating Hallucination Detection With LLM-First Human-Adjudicated Assessment
This paper investigates whether standard benchmarks underestimate LLM performance by re-evaluating hallucination detection datasets using an LLM-first, human-adjudicated assessment method. The study finds that incorporating LLM reasoning into the adjudication process improves agreement and suggests that model-assisted re-evaluation yields more reliable benchmarks for ambiguity-prone tasks.
We’ve been analyzing how people are using LLMs for legal and compliance tasks (GDPR, AI Act, etc.).
Analysis of LLM usage in legal and compliance tasks reveals that models often produce confident but unverifiable citations, raising questions about reliable legal grounding for AI outputs.
Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations
This paper presents a mechanistic analysis of why LLMs hallucinate when reasoning over linearized structured knowledge, finding that hallucinations stem from systematic internal dynamics such as attention on shortcut cues and failures in semantic grounding in feed-forward layers, rather than random noise.
Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection
This paper introduces CiteTracer, a multi-agent framework for detecting citation hallucinations in LLM-generated scientific writing, achieving high accuracy on synthetic and real-world benchmarks.
I spent 40% of my development time preventing an LLM from citing sources wrong. here are the 7 failure modes I found
A developer building an AI legal assistant for a German law firm details seven specific LLM citation failure modes and the prompt-engineering fixes used to meet strict legal citation standards.