Tag
This paper presents the first comprehensive overview of metacognition in LLMs, arguing that behaviors like confidence calibration and self-verification are facets of a unified metacognitive ability, and taxonomizes methods and benchmarks for evaluating and improving these abilities to enhance LLM reliability and transparency.
Apodex-1.0-H is a new deep research model that introduces a multi-agent architecture where the model decomposes tasks, spawns specialist sub-agents, and uses self-verification and iterative improvement to produce answers. Open-weight variants are available on HuggingFace.
A 4 billion parameter open model from the Apodex family outperforms 30 billion parameter models on web research benchmarks, attributed to careful training data and self-verification techniques rather than raw scale, suggesting a more democratic trajectory for AI capability.
Discussion on the importance of self-verification loops in AI models like Claude to improve reliability and reduce the need for manual oversight.
FineVerify is a self-verification framework for agentic search that decomposes questions into sub-questions, verifies sampled candidates, and selects the best one, achieving substantial accuracy improvements over baselines on multiple benchmarks, including enabling GPT-5-mini to surpass GPT-5 on BrowseComp-Plus.
Proposes Self-Verified Distillation, a method where LLMs generate and self-verify candidate solutions from unlabeled seed questions using prompt-based verification, then train on the filtered dataset, achieving significant gains on math, science, and coding benchmarks across Qwen3 models.
This paper investigates how large reasoning models can detect and correct their own errors internally, identifying a highly interpretable critique vector that enhances error detection without additional training, improving test-time scaling performance.
RLanceMartin highlights new self-verification (Outcomes) and self-learning (Dreaming) features for Claude discussed at the Code With Claude event.