Can Your AI Governance Policy Actually Stop an Agent?

Reddit r/AI_Agents News

Summary

The article discusses the gap between described and established governance in AI agents, referencing a paper by Paulo Cavallo, and highlights how companies like Microsoft, IBM, and Lyzr are developing control-plane capabilities to enforce policies at runtime.

I've been looking at how companies are approaching governance as AI moves from generating outputs to actually taking actions, and I came across a distinction in this paper that I found particularly useful: “Described governance” vs. “Established governance.” Described governance is what policies, frameworks and governance documents say should happen. Established governance is what the architecture and tooling actually enforce when an agent is running. That gap is the core argument of “Described vs. Established Governance in Agentic AI: Closing the Gap Between Policy and Enforcement” by Paulo Cavallo. The paper breaks the gap into three levels: Policy-level: the policy specifies what should be done, but not how it will be enforced. Tooling-level: an enforcement mechanism exists, but isn't straightforward to operationalize. Enforcement-level: the tooling works, but doesn't actually cover the full risk surface. The distinction sounds obvious, but it becomes much more important with agents. “Agents must use least-privilege access” is a governance policy. An architecture that actually prevents an agent from calling an unauthorized tool is governance enforcement. The paper's practitioner case study is interesting for exactly this reason. It documents the process of operationalizing Microsoft's Agent Governance Toolkit against a multi-agent system, including an installation failure, a workaround, and eventually a working demonstration. So even when the governance mechanism exists, getting policy translated into something that reliably operates at runtime is another problem. That makes me think the next phase of AI governance is going to be less about adding more policy documents and more about the infrastructure underneath them. This is where the AI control plane becomes interesting. Microsoft is building control-plane capabilities into Foundry, IBM has introduced an Agentic Control Plane in watsonx Orchestrate, and Lyzr is taking a more framework-agnostic approach to governing agents across different stacks. Different implementations, but a similar underlying idea: governance needs to become something the system can actually enforce, observe and audit not just something an organization says it does. So I'm curious where people draw the line. What should count as “governed” AI: having the policy and audit trail, or being able to prove at runtime that an agent cannot cross its permitted boundary?
Original Article

Similar Articles

AI agents are fun until they start touching real data

Reddit r/AI_Agents

The article discusses the governance challenges that arise when AI agents interact with real company data and tools, highlighting the need for policy enforcement and audit trails, and mentions Trust3 AI as a potential solution.