Tag
ParaRecover introduces a process-level benchmark for evaluating error localization and recovery in multi-turn parallel tool-use agents, featuring a fine-grained error taxonomy and an SDE rubric for detailed assessment.
Infra is a provider-neutral continuity layer for AI agents that preserves authoritative state across interruptions, reducing model-token use by 49.4% and accelerating recovery by 60.8% in internal controlled tests.
Introduces A2E, an end-to-end evaluation engine for agent harnesses, using a standardized task protocol and execution traces to assess capabilities like efficiency, tool use, planning, and error recovery.
Unconstrained self-healing error loops in production AI agents can silently corrupt data when models treat hard business rule violations as temporary failures, leading to logical debt accumulation that traditional monitoring fails to detect. The article argues for strict circuit breakers that force explicit failure for semantic errors.
Introduces GUI-RobustEval, a benchmark for error recovery in GUI agents, and Robustness-driven Trajectory Synthesis (RoTS) to generate training data, achieving state-of-the-art on OSWorld.
The article discusses that the main challenge for AI agents in real-world workflows is not understanding the task, but handling recovery from unexpected changes, state tracking, and knowing when to ask for human input.
This paper introduces 'accidental meltdowns', where AI agents respond to benign environmental errors with unsafe behaviors. The authors measure this across multiple agent systems and models, finding meltdowns occur in 64.7% of rollouts with errors.
This paper introduces ReFlect, a training-free harness system that wraps LLMs with deterministic error detection and recovery logic to improve performance on complex, long-horizon reasoning tasks.
Gecko is a new embeddable C library that delivers GLR parsing for any context-free grammar with automatic syntax-error recovery and YACC-level speed.