AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents

Hugging Face Daily Papers Papers
open-source llm-agents debugging failure-analysis root-cause-diagnosis agent-toolkit

Summary

AgentDebugX is an open-source debugging framework for LLM agents that organizes failure debugging as a closed loop of detect, attribute, recover, and rerun, with a core component DeepDebug achieving strong attribution accuracy and repair capability on benchmarks.

LLM agent failures are difficult to debug because the step where an error surfaces is often not the one that caused it. Existing observability tools replay execution traces but provide little support for identifying the root cause or translating diagnosis into recovery. We present AgentDebugX, an open-source debugging framework that organizes debugging as a closed loop of Detect, Attribute, Recover, and Rerun. At its core, DeepDebug performs multi-turn root-cause diagnosis through global trajectory understanding, structure-guided investigation, and cross-examination. On the Who and When benchmark, DeepDebug achieves the best strict attribution accuracy among the evaluated methods on both tested open-weight backbones, reaching 28.8 percent exact agent-and-step accuracy on qwen3.5-9b versus 21.7 percent for the strongest single-pass baseline. On GAIA, DeepDebug repairs 13 of 73 failed tasks in a single rerun, compared with 4 to 6 for three decoupled self-correction baselines, improving overall accuracy from 55.8 percent to 63.6 percent. AgentDebugX exposes this workflow through a Python library, CLI, web console, and installable agentic skill, and provides an opt-in Error Hub for sharing scrubbed failure-diagnosis-repair bundles and reusing them as debugging memory.
Original Article
View Cached Full Text

Cached at: 07/22/26, 06:41 AM

Paper page - AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents

Source: https://huggingface.co/papers/2607.18754 Authors:

,

,

,

,

,

,

,

,

,

,

Abstract

LLMagentfailuresaredifficulttodebugbecausethestepwhereanerrorsurfacesisoftennottheonethatcausedit.Existingobservabilitytoolsreplayexecutiontracesbutprovidelittlesupportforidentifyingtherootcauseortranslatingdiagnosisintorecovery.WepresentAgentDebugX,anopen-sourcedebuggingframeworkthatorganizesdebuggingasaclosedloopofDetect,Attribute,Recover,andRerun.Atitscore,DeepDebugperformsmulti-turnroot-causediagnosisthroughglobaltrajectoryunderstanding,structure-guidedinvestigation,andcross-examination.OntheWhoandWhenbenchmark,DeepDebugachievesthebeststrictattributionaccuracyamongtheevaluatedmethodsonbothtestedopen-weightbackbones,reaching28.8percentexactagent-and-stepaccuracyonqwen3.5-9bversus21.7percentforthestrongestsingle-passbaseline.OnGAIA,DeepDebugrepairs13of73failedtasksinasinglererun,comparedwith4to6forthreedecoupledself-correctionbaselines,improvingoverallaccuracyfrom55.8percentto63.6percent.AgentDebugXexposesthisworkflowthroughaPythonlibrary,CLI,webconsole,andinstallableagenticskill,andprovidesanopt-inErrorHubforsharingscrubbedfailure-diagnosis-repairbundlesandreusingthemasdebuggingmemory.

View arXiv pageView PDFProject pageGitHub5Add to collection

Get this paper in your agent:

hf papers read 2607\.18754

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2607.18754 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2607.18754 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2607.18754 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Agent failure clusters changed how I think about debugging

Reddit r/AI_Agents

A developer shares how visualizing failure clusters across many agent runs changed their debugging approach, emphasizing the need for a feedback loop so agents learn from past mistakes rather than treating failures as isolated bugs. The post highlights manual workarounds and a platform called BentoLabs that implements closed-loop improvement.

AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems

arXiv cs.CL

This paper introduces AgentForesight, a framework for online auditing and early failure prediction in LLM-based multi-agent systems. It presents a new dataset, AFTraj-22K, and a specialized model, AgentForesight-7B, which outperforms leading proprietary models in detecting decisive errors during trajectory execution.