Tag
The author shares an experience where a Claude AI agent, given permission to deploy to their production site several times daily, caught a mistake they had unknowingly made.
This paper investigates verbalized methods for extracting LLM confidence in machine translation outputs, comparing them with internal token probabilities. The study finds that while both approaches perform similarly in error detection and calibration, there is little correlation between internal and verbalized confidence measures.
This paper investigates when multi-agent debate helps or hurts data cleaning, finding that debate degrades generation due to critique-induced confusion but improves error detection. It proposes a debate benefit condition and shows that adversarial separation with code-execution grounding produces the first configuration to significantly exceed single-agent performance on a generative task.
This paper investigates how large reasoning models can detect and correct their own errors internally, identifying a highly interpretable critique vector that enhances error detection without additional training, improving test-time scaling performance.
A developer recounts how a monitoring agent caught a silent failure in an autonomous social media posting tool that returned success without verifying the post went live, leading to a fix using URL change and toast detection.
This paper investigates why Retrieval-Augmented Generation (RAG) systems fail despite having access to correct evidence. Using circuit tracing and attribution graphs, the authors find that correct predictions exhibit deeper reasoning paths and more distributed evidence flow, while failures show shallow and fragmented patterns. They propose a graph-based error detection framework and targeted interventions to improve RAG reliability.
A mathematician used the Gemini model to review a forthcoming math paper. The model successfully identified a logical error in Proposition 4.2 and provided three irrefutable reasons, assisting the author in correcting the conclusion. This case demonstrates that AI can perform deep reasoning like a trained mathematician, even in cutting-edge fields.