Anyone else hitting a wall with the "Day 2" side of shipping AI agents?

Reddit r/artificial News

Summary

A practitioner shares real-world challenges in deploying AI agents to production, highlighting that governance, auditing, and deployment guardrails are now the bottleneck, not agent building, and notes emerging solutions like Lyzr Control Plane and Microsoft's reference architectures.

For the last six months, our team was completely focused on agent logic, testing prompts, trying out different multi-agent frameworks and building nice flow charts in Python. Everything looked great in local demos and leadership was thrilled but as soon as we tried pushing these agents into actual production for client-facing workflows, the real pain started and it had almost nothing to do with the LLMs themselves. The bottleneck shifted overnight from "how do we build this agent" to "how do we safely deploy, audit, and govern it." Suddenly, we were dealing with messy manual approvals, no clean way to roll back when a tool call broke, zero visibility into who owned which running agent and security teams panicking about identity management and raw cloud keys. We spent weeks trying to glue together custom GitHub Actions, Docker scans and ad-hoc logging scripts just to get basic deployment guardrails in place. It made me realize that the agent ecosystem is repeating the early DevOps transition. Building the code is the easy part now; managing the pipeline around it is where projects quietly stall out. Tools like Lyzr Control Plane, Microsoft's new reference architectures and dedicated agent gateways are starting to treat agent deployment like actual enterprise software with evaluation gates and automated pipelines which feels like a necessary shift. Are you building custom CI/CD wrappers internally to scan and deploy your agents, or are you moving toward specialized orchestration and control layers?
Original Article

Similar Articles

How Microsoft Ships Thousands of Production AI Agents (18 minute read)

TLDR AI

Microsoft shares insights from shipping thousands of production AI agents at enterprise scale, covering the engineering challenges of moving from prototype to production, including the agent harness, retrieval-as-a-subagent, agent identity, and rubric-based evaluation loops.

The absolute nightmare of putting AI agents into actual production

Reddit r/artificial

The article discusses the significant challenges enterprises face when deploying AI agents to production, highlighting the lack of standard deployment infrastructure, security concerns, and the need for an orchestration layer to manage agent lifecycles.