We went from "AI says something embarrassing" to "$25M deepfake fraud" in about two years

Reddit r/artificial News

Summary

The article discusses the shift from minor AI embarrassments to a $25 million deepfake fraud case at Arup, highlighting that the real AI threat is social engineering via synthetic media, not just hallucinations or bias.

​ The Arup case wasn't a hack in the traditional sense — it was a deepfake convincing someone to authorize a transfer. No exploit code, no malware, just sufficiently good synthetic media plus normal human trust. Feels like the conversation around AI risk is still stuck on hallucinations and bias while the actual money being lost is going through social engineering supercharged by generation quality. Are we just behind on naming the real threat model here?
Original Article

Similar Articles

Deepfake scams that fooled entire companies and families

Reddit r/ArtificialInteligence

In 2025, 52% of 346 major AI incidents involved deepfakes, leading to scams like a $25M transfer and a $1.7M investment loss through AI-generated voices and videos. The article reports on these cases and asks for tips to detect fakes.

Nobody is safe from celebrity AI deepfakes

The Verge

The Verge reports on the rise of AI-generated celebrity deepfakes on Instagram, highlighting a fake Mia Goth fan account that spread a viral AI image and the broader challenge platforms face in policing synthetic likeness misuse.

AI deepfakes are getting out of hand.

Reddit r/artificial

Microsoft is adding third-party deepfake detection and impersonation warnings to Teams in November 2026, as malicious voice call attempts on the platform surged nearly 10x in a year.