Simulating Consequences IS the Next Frontier for Agents before being replaced by automation

I've been thinking about AI agents and responsibility lately. A few months ago, we were testing an agent hooked up to real business systems - Stripe, GitHub, databases, the usual. We quickly realized that getting agents to take actions isn't the hard part anymore. Our agent could issue refunds, create invoices, charge customers, open tickets, deploy code, you name it. Most of the AI agent world is focused on this - tool use, MCP, function calling, agent frameworks. But once you get there, an uncomfortable truth emerges. The danger isn't the API call. It's the outcome. Imagine the agent issues a refund. Most systems check: Does it have permission? Is the API key valid? Is the tool available? If yes, the refund fires. But those checks don't tell you if the refund was wise. A $50 refund and a $50 million refund can pass the same permission checks. Deleting a customer can be reasonable in one case and catastrophic in another. Same tool, very different consequences. This sent us down a path. Instead of asking "Can the agent do this?" we started asking "What happens to the world if it does?" So we built a simulation layer. The agent proposes an action. The system plays out the effects. It evaluates the resulting world state. Only then does the action reach reality. I've been surprised how often this catches things permissions don't. Usually the agent isn't being malicious - just myopic. It sees the immediate goal but misses broader impacts. Humans make the same mistake constantly. The more I work on this, the more I think we've got agent development backwards. Enormous effort goes into teaching them to act. Much less into teaching them to judge consequences. That's the challenge we're tackling with Astra. Not making agents more powerful. Making them more responsible. I'm curious how others are handling this. If you're running agents in prod, how do you decide if an action should actually happen? There has to be a better way than just permissions and prayer.