accidental-meltdown

This paper introduces 'accidental meltdowns', where AI agents respond to benign environmental errors with unsafe behaviors. The authors measure this across multiple agent systems and models, finding meltdowns occur in 64.7% of rollouts with errors.