honest question: how are you actually handling agent auditability in production?
Summary
A practitioner discusses the challenge of implementing audit trails for AI agents in production, mentions a vendor solution, and seeks input from the community on real-world setups.
Similar Articles
How are you handling audit and compliance for agentic systems in your org?
A practitioner details the real-world challenges of audit, compliance, and governance for autonomous AI agents, including identity, approvals, logging, and accountability, while asking the community for solutions.
AI Agent Audits ?
A practitioner shares concerns about an upcoming audit revealing undocumented AI agents in production, highlighting governance gaps and risks with customer PII access.
How do you keep an audit trail when an agent runs on a human's credentials?
Discusses the challenge of maintaining audit trails when AI agents operate using human credentials, highlighting security and accountability concerns.
Best tools for monitoring and auditing autonomous AI agent behavior at runtime, what's actually working in prod?
A practitioner shares challenges and tools for monitoring autonomous AI agents in production, covering runtime prompt injection detection, tool-call auditing with reasoning traces, behavioral drift detection, and multi-agent authorization, while testing tools like Arize Phoenix, Protect AI Guardian, Metoro, Alice, Asqav, and Microsoft Agent Governance Toolkit.
Those of you running AI agents in prod — how are you actually managing their permissions?
The article asks how engineers manage permissions for AI agents in production, highlighting common problems with broad access and lack of audit trails.