How to check what your AI agent can actually reach before it goes live

Reddit r/AI_Agents News

Summary

一篇基于论坛讨论的经验帖,总结了 AI agent 上线前的权限审查清单:给 agent 独立身份、按实际凭证核对可访问范围、严格分离读写权限、用拒绝性问题测试过度授权,以及检查撤销权限后缓存答案是否仍然泄露。

Someone posted here last month that their company's internal bot had answered a question with an unannounced reorg plan and salary bands. It was only supposed to read the wiki. By their account, whoever set it up had clicked yes on access to the company Drive, and the bot indexed everything, the HR folder included. The post also said an agent whose whole job was summarising a few wikis turned out to have delete access on the shared drive and could send email as the person who set it up. Nobody gave it that. It inherited it. The post has since been removed, but its 70-plus replies are still up. The replies in that thread add up to a check you can run before an agent touches anything real. Give it its own identity. An agent that runs as the person who set it up gets everything that person can see and do, now and after their next promotion. A separate account with its own narrow access means it only has what you chose to give it, and nothing changes when that person moves teams or leaves. If it answers questions for different people, go one step further and check access against the person asking, at the moment it looks something up, not only against the agent. List what it can reach from the credentials, not from memory. Pull the real grants from the admin console or the config and compare them with what the job needs. A few people in the thread keep a written list of what each agent should have and flag any gap between the two. Keep reading and doing apart. A summariser needs read access to a few folders. It doesn't need delete, and it definitely doesn't need to send email as a human. If the job needs an action, that's a separate, narrower credential. Ask it the questions it should refuse. Draft plans, salaries, anything from a folder it was never meant to see. If it answers, the scope is too wide. Run before launch, that one test would probably have caught the reorg leak. Check what happens after you take access away. Remove a test document, then ask about it again in the same chat and in a new one. Cached answers and summaries can keep serving what the permissions no longer allow. None of this needs a new tool. It's the access review you'd do for a new hire, and one reply in the thread put it better than a policy doc: treat it like a smart but drunk intern.
Original Article

Similar Articles

The terminal is the most honest place to test an agent

Reddit r/AI_Agents

作者讨论在终端中运行 AI agent 时权限决策的不可见性,主张使用字段级读取范围、类型化记录以及对写操作进行人工审批,使每一步的权限决定都可见且可审计。

How are you securing your AI infrastructure?

Reddit r/AI_Agents

探讨随着 AI agents 开始访问内部系统并自主执行操作,传统围绕'人使用单一应用'构建的安全边界失效的问题,并讨论应在 agent 层、网关层还是系统层实施策略控制,以及被拦截时如何保留 agent 运行上下文以便审计。

@knoYee_: https://x.com/knoYee_/status/2062780637677752366

X AI KOLs Timeline

The author reviews three months of experience using multi-agent collaboration, summarizing five main pain points (such as conflicts between agents, ignoring boundary conditions, self-censorship failure, difficulty in merging decisions, and exposing harder problems after compressed execution) and two insights (the high value of read-only review agents, and that agent conflicts expose ambiguous requirements), emphasizing the core decision-making role of humans in AI collaboration.

Permission leaks to check when putting an AI assistant on company data

Reddit r/AI_Agents

讨论在将 AI 助手接入公司内部数据时常见的权限泄漏问题,并给出了一份检查清单和测试方法,包括按用户身份查询源数据、字段级权限、总量与排名泄漏、缓存与日志的同等保护、以及用假记录和测试用户做回归测试。