What do you require before an agent may change something in the physical world?

Reddit r/AI_Agents News

Summary

作者分享了其硬件实验台上的 AI 代理因误信静默通道而误判电路板断电的教训,并提出了一套分层的代理物理操作权限规范:读取仪器与摄像头始终允许、切断电源可自主执行但需经验证的 kill path 通知人类,而任何为设备上电的操作必须等待人工确认。

In August, an agent on my bench decided a board was dead. SSH to it timed out and a network sweep found nothing, so it reported the board as unpowered and started planning around that. The bench camera was pointed at the board the whole time, showing its lit screen, and the power supply was sourcing 0.635 A into it. One quiet channel had turned into "the board is off." So my agents now work on a ladder. Reading instruments and looking through the camera are always allowed, and any claim about the physical world has to come from a reading, not from a silent channel. Moving the camera is allowed too. Cutting power is allowed without asking, because it is the safe direction, but the agent has to tell me right away, and only through a kill path we have tested on the real hardware. Anything that energizes the bench waits for a person. So my question for this sub: where do you draw that line, and how do you prove the agent's kill path works before you trust it? The talk and the code links are in my comment below. Disclosure: I build electronics, and the agents I describe run in a harness I built; Hapimatic is my project at Solid Product Design.
Original Article

Similar Articles

where do you draw the line on what you let an agent log into

Reddit r/AI_Agents

作者探讨构建会操作真实账户的 AI agent 时的授权边界:读取类操作允许常驻访问,而发送、消费、删除或发布类操作每次都需人工确认,并询问社区如何在大规模运行 agent 时处理写权限凭证。

The terminal is the most honest place to test an agent

Reddit r/AI_Agents

作者讨论在终端中运行 AI agent 时权限决策的不可见性,主张使用字段级读取范围、类型化记录以及对写操作进行人工审批,使每一步的权限决定都可见且可审计。

How to check what your AI agent can actually reach before it goes live

Reddit r/AI_Agents

一篇基于论坛讨论的经验帖,总结了 AI agent 上线前的权限审查清单:给 agent 独立身份、按实际凭证核对可访问范围、严格分离读写权限、用拒绝性问题测试过度授权,以及检查撤销权限后缓存答案是否仍然泄露。