Should an AI agent be allowed to say “I don’t know”?

Reddit r/AI_Agents News

Summary

The article explores whether AI agents should be allowed to express uncertainty, such as saying 'I don't know', in their actions and governance, emphasizing the value of honest communication over forced classification.

Say an agent runs a shell command. We can see that Bash executed, but that doesn’t necessarily tell us what actually happened. It could have read a file, changed code, deleted something, touched infrastructure, or done several of those things at once. If the runtime can’t confidently determine the effect, should the governance layer still be forced to label it safe, unsafe, destructive, etc.? I’m increasingly thinking unknown is a perfectly valid answer. I’d rather have the system say “I don’t have enough evidence” than manufacture certainty. Curious how people here handle this. Do you preserve unknown as a real state, or force everything into a classification?
Original Article

Similar Articles

When should an AI agent question its own data?

Reddit r/AI_Agents

The article discusses how AI voice agents should handle situations where customers disagree with backend system data, exploring design options like additional verification or human handoff.

Who decides what an AI agent is allowed to know?

Reddit r/AI_Agents

The author raises concerns about who controls data access for AI agents, questioning if there are established governance architectures, and shares a repo to explore the problem.