Tag
OrchestraBench is a new benchmark that evaluates multi-agent orchestration frameworks on failure modes, recovery, and decomposition quality, using failure-injection and cascade-radius metrics to diagnose where and why pipelines fail.
This paper systematically investigates instability in reinforcement learning for small language model agents (70-500M parameters), identifying three failure modes and proposing robust techniques including a merge-and-reinitialize adapter approach and safety mechanisms; it achieves stable convergence and improved win rates.
This paper introduces a novel evaluation method called shadow evaluations to test whether AI agents can conduct open-ended AI research. In two case studies, agents completed all engineering without human help but could not make substantial progress on the research questions, revealing five recurring failure modes.
A discussion on how treating 'human rejection' as a separate failure mode from 'agent malfunction' significantly impacts the reliability and debugging of AI agents in production.
This paper systematically investigates failure modes in reinforcement learning for small language models (70-500M parameters) using PPO, identifies silent LoRA freezing, numerical overflow, and catastrophic policy collapse, and proposes a robust system with merge-and-reinitialize adapters, float32 precision, and a safety mechanism. The approach converges stably and outperforms baselines with less data.
A developer shares consistent failure modes of AI agents after a year of shipping code with them, including confidently wrong code, inability to maintain cross-file architecture, lacking pushback on bad decisions, and security edge case issues.
The author reflects on Gartner's prediction that 40% of agentic AI projects will be canceled by 2027, emphasizing that the real failure is not model incompetence but quiet failures in production due to bad data or API issues, and that most teams measure single task completion rather than reliability over hundreds of runs.
The author shares two years of experience building a platform with AI, identifying six recurring failure modes (Band-Aid, Assumption, Drift, Hallucination, Lack of Common Sense, Path of Least Resistance) and argues that even as models improve, these failure modes persist, becoming harder to detect.
Bhavin Jawade discusses several failure modes of on-policy distillation for training large language models, including early mistakes becoming uncorrectable, stronger teachers being worse, privileged information conditioning failing to transfer, and thinking collapse from dense supervision.
BhavinJawade surveys papers on failure modes of on-policy distillation and its variants, listing several recent arxiv papers including 'The Many Faces of On-Policy Distillation' and others.
This paper demonstrates that post-training quantization can silently alter how large language models reason, even when task accuracy is preserved, through a taxonomy-based analysis of 30,000 chain-of-thought outputs across multiple models and benchmarks.
The author discusses the practical failure modes of AI agents that use paid tools, such as cost unawareness, double-spends, and the need for human approval, suggesting that agent payments should be treated as a separate execution layer.
Liquid AI releases Antidoom, an open-source method that fine-tunes reasoning models to break repetitive token loops (doom loops), reducing failure rates from ~23% to 1% on Qwen3.5-4B without retraining or RL.
This paper identifies five failure modes in perturbation-based benchmark-validity audits used for AI governance, demonstrating that implementation details can silently manufacture conclusions. It proposes a due-diligence gate to improve the reliability of evaluation evidence.
An Anthropic lead engineer leaked a 12-page document detailing five common failure modes in agentic loops and was fired shortly after. The thread summarizes the key failure types including blind, tangled, nodding, amnesiac, and manual loops.
This article discusses the next expected failure mode in AI agents, which will likely be more complex than a single bad prompt.
This article explores common reasons why AI agents fail shortly after being deployed in production, highlighting pitfalls and lessons learned.
A practical guide explaining why naive multi-agent systems fail and how to build coordinated AI agent teams using Builder, Judge, and Manager roles with clear handoffs and verification.
Discusses common failure modes of AI agents in enterprise environments, such as over-reliance on long-term memory and stateless tool gating leading to security risks.
The article highlights a common failure mode in coding agents where they report tasks as 'done' while leaving hidden issues like insufficient tests, missed edge cases, and introduced bugs, creating a trust problem for developers.