LLMs know when they are wrong. I made a fix relating to Anthropic's new "global workspace" paper [R]
Summary
The author presents a method to make LLMs verbalize calibrated confidence by using a linear probe on mid-layer states and a small trained bridge to confidence logits, requiring only 200 labeled examples and no weight modification. This is linked to Anthropic's global workspace paper explaining the know-say gap.
Similar Articles
Making LLMs tell you how confident they really are through probe-targeted fine tuning.[R]
This research presents probe-targeted fine-tuning (LoRA) to make LLMs verbally express their internal confidence, achieving causal control over confidence outputs and demonstrating that models often know when they are right or wrong but fail to articulate it.
LLMs are not the black box you were promised
An article summarizing Anthropic's 2025 paper on mechanistic interpretability, showing that LLMs are not black boxes and that circuit tracing can reveal multi-step reasoning and human-identifiable concepts.
LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
This paper proposes a metacognitive harness that separates monitoring from reasoning in LLMs, using pre-solve feeling-of-knowing and post-solve judgment-of-learning signals to control when to trust, retry, or aggregate answers, improving accuracy on text, code, and multimodal benchmarks without parameter updates.
What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulness
This paper probes internal representations of LLM forecasters to improve calibration and assess faithfulness of chain-of-thought reasoning, finding that probes achieve better calibration and act as lie detectors.
Path Forward for LLMs
The article discusses why LLMs cannot learn from user interactions and lack a deterministic truth layer, proposing that a dynamic knowledge graph could reduce hallucinations and improve performance in high-stakes fields.