The agent says "I sent the email." It never called send_email. Does this hit you too?

One agent failure mode I keep thinking about, and I honestly don't know how often it actually happens in practice. The model writes "done, I've sent the email" or "I've updated the record," and it never actually made the tool call. Or it made the call but it never went through, and the model just assumes it worked and keeps going. No error, no malformed JSON, nothing obvious. You'd only find out later when the thing never happened. Structured outputs and strict mode do nothing here. They check the shape of a call when there is one. But here there's either no call at all, or a call that silently failed, and the model talks like everything is fine. And it doesn't really get better with smarter models. A smarter model is just more convincing when it says it did something. So genuinely asking people running agents in prod: has this actually hit you, and how do you catch it today?