When an agent documents its own audit log, things get weird
Summary
The author discusses a failure mode encountered while building Sentience Governor, a Python library for Claude Code that monitors agent actions and produces audit reports. The AI sometimes reconstructed explanations from raw traces, blurring the line between measured facts and probabilistic interpretation.
Similar Articles
Anyone else struggling with AI auditability?
The author describes a challenge with AI auditability where an agent's decision lacked traceability to the active policy version, and asks for advice on building effective decision trails for AI agent decisions.
@UnTalNixon_exe: The biggest problem with AI agents isn't that they hallucinate. It's that no one can explain why they made a decision. …
Semantica is an open-source tool that turns any data into a Context Graph, logging every AI agent decision with its full causal chain and W3C PROV-O provenance, enabling deterministic explainability for finance, healthcare, and government.
We showed an AI agent its own governance record, and it started using it
An experiment with a local governance harness for AI coding agents shows that when the agent's own governance record is surfaced in its context, the agent begins to self-correct by following policies and asking for intent declarations, without hard enforcement.
My agents kept lying nonstop so I made them show their work
The author describes building a 'gate' that logs tool calls and verifies that claims in an AI agent's answer correspond to actual log entries, forcing the agent to show its work and reducing hallucinated responses.
Don't let the model write the audit log
The article warns against using model-generated narration as the authoritative audit log for AI agents, advocating for persisting raw tool call data instead, and suggests a simple diff check to catch discrepancies.