My ai assistant almost forwarded my bank statement to a stranger and barely anyone knows this attack exists.

Reddit r/artificial News

Summary

A user describes how a prompt injection attack embedded in an email almost tricked their AI assistant into forwarding bank statements to a stranger, highlighting a real security risk for AI agents with account access.

Okay this genuinely scared me and I don't think enough people are talking about it. I’ve been using an ai agent connected to my email and calendar to handle some of the busywork. A few days ago I got an email that looked like normal spam, some random newsletter looking thing. Buried in the html of that email was a hidden instruction telling any ai reading it to find financial documents and forward them to an outside address. My agent almost did it. I caught it mid action because I happened to have a confirmation step turned on, but if I hadn't, it would have just quietly forwarded stuff without asking me first. This apparently called prompt injection and it's not some rare theoretical thing, there's already been real world cases with tools like microsoft copilot getting exploited the same way. Any ai with access to your inbox, calendar, or other accounts is a potential target because it can't always tell the difference between your instructions and instructions hidden inside the content it is reading. If you're using any kind of ai agent connected to your accounts, please actually test what happens if it hits something malicious. Most people including me had no idea this was even possible until it almost happened to me.
Original Article

Similar Articles

What happened after 2k people tried to hack my AI assistant

Hacker News Top

An AI assistant called Fiu, built on OpenClaw and Claude Opus 4.6, survived over 6,000 email-based prompt injection attacks from 2,000 people without leaking its secret. The experiment highlights the effectiveness of model-level prompt injection resistance and cost/operational challenges.

A €0.01 bank transfer could compromise a banking AI agent

Hacker News Top

Blue41 disclosed an indirect prompt injection vulnerability in Bunq's AI assistant, where a small bank transfer with a malicious transaction description could turn the assistant into a spearphishing vector, highlighting a broader architectural challenge for financial AI agents.

What happened after 2,000 people tried to hack my AI assistant

Simon Willison's Blog

A blog post reports that after 6,000 attempts by over 2,000 people, no one successfully leaked secrets from an AI assistant (powered by Opus 4.6) via prompt injection, highlighting improved model resistance but cautioning against overconfidence.