self-correction

This paper introduces Hybrid Search, a method to enhance automatic speech recognition in large audio language models by leveraging hidden-state interactions between the ASR-LLM and base LLM for targeted token correction, improving performance beyond global LLM-correction strategies.

Adding a self-correction loop to an LLM pipeline for structured data extraction reduced consistency from 85% to 62%, due to compounding noise and regeneration drift. The article discusses potential solutions like granular diff mechanisms or deterministic gates.

The paper empirically studies self-correction in code generation using uncertainty estimation methods, finding that uncertainty-based approaches fail to improve Pass@1 accuracy, while verification-based methods yield significant gains.

This paper introduces DARC, a diagnosis-guided recovery harness that makes agent self-correction selective by profiling failure modes and pruning mismatched interventions before test-time correction, improving performance on ALFWorld, AppWorld, and XBRL Finance.

This paper introduces SFS-DPO, a reinforcement learning two-stage framework for step-level self-verification and self-correction in LLMs, with a teacher-assisted variant SFS-DPO-R. It demonstrates improvements in self-correction effectiveness across multiple LLMs with less training data than prior approaches.

Microsoft researchers published a landmark study introducing LoopsBench, a framework for evaluating self-correcting coding agent loops, and outlining the shift from harness engineering to loop engineering for reliable autonomous development.

A new verifier-free breadth-depth refinement framework improves LLM reasoning at test time by sampling multiple rollouts, iteratively refining each via self-critique, and aggregating with majority voting. It consistently outperforms greedy decoding, majority voting, and verifier-based selection across several math benchmarks and open-weight models.

Shared a prompt methodology based on LLM self-correction research, emphasizing that self-checking is limited without external feedback, and recommending progressively enhanced prompting strategies such as adversarial review.

This paper shows that apparent LLM self-correction gains often stem from format repair rather than improved reasoning. Across multiple model scales, format effects dominate content effects, with content margins near zero on capable models, suggesting the field has misattributed a minority of measured self-correction to actual content improvement.

Alibaba's Qwen agent autonomously coded for over 10 days in an empty repo, filing issues, writing code, running tests, fixing failures, and merging. It still required some feedback, but demonstrates a self-correcting autonomous loop.

This paper introduces the Human–LLM Reflection Framework (HRF) to compare human and LLM revision behavior, finding that LLM reflection often yields zero or negative information gain and behaves more like conditioned re-generation than genuine error-driven revision.

Presents AMTFV, an agentic framework that decouples mathematical verification modeling from execution via a Mathematical Tool Flow interface, improving LLM answer verification and revision on five challenging math datasets.

ViSAGE is a multimodal agentic memory framework for long-form video understanding that builds self-correcting, entity-centric memories via cross-modal binding, bidirectional memory refinement, and multi-agent cross-verification, achieving 5.9% higher accuracy than baselines.

A user experiments with Qwen AgentWorld and finds a system prompt that enables self-correction in reasoning traces, as demonstrated by the classic car wash test.

A comparison of two AI coding agents building a Mario game: Laguna S 2.1 in Poolside's agent took 62 minutes with self-correction and passed tests, while a previous Qwen model took hours and needed human help; highlights oracle discipline and native harness advantages.

Introduces Scientific Feasibility Control (SFC), a conformal prediction framework that provides statistical guarantees for scientific reasoning validity in LLMs, achieving 50.1% on PhyX physics reasoning, outperforming DeepSeek-R1 and GPT-4 while reducing scientific violations by 73%.

This paper proposes a reward-driven LLM agent workflow that integrates POMDP routing and self-correcting reward models, achieving a 24.5% improvement in task success rate on benchmarks like ALFWorld and WebShop.

Introduces Self-Correcting Coupled Markov Jump Processes (SC-CMJP) and a training-free sampler CO2Jump for concurrent image understanding and generation, achieving state-of-the-art joint performance on editing, maze, and nonogram tasks.

This paper explores using a compact Small Language Model (Qwen2.5-1.5B) retrained with GRPO and combined with a validator-guided correction loop for autonomous industrial control. The framework achieves high alignment accuracy and low latency, demonstrating practical viability for edge deployment.

This paper introduces SPARC, a spectral-algebraic theory explaining the self-correction blind spot in autoregressive language models, where models fail to correct their own errors but can fix identical external errors. The theory proves the blind spot arises when the spectral radius of an error-propagation operator is at least one, derives a threshold for correction markers, and provides convergence guarantees for RL-based self-correction training.