deepfake

In 2025, 52% of 346 major AI incidents involved deepfakes, leading to scams like a $25M transfer and a $1.7M investment loss through AI-generated voices and videos. The article reports on these cases and asks for tips to detect fakes.

This article warns that an AI voice project with 37,000 stars on GitHub could become a new weapon for telecom fraud, introducing its features such as AI cover songs, voice conversion, and real-time voice changing, as well as its easy-to-use WebUI interface.

A grandson uses AI-generated footage to insert his grandmother into her favorite movie, creating a humorous video shared on Twitter.

The article discusses AI-generated images posted on social media that fool both users and moderators, highlighting how platforms fail to label or flag AI content and actively obfuscate its origin.

This article discusses a decision tree for AI labelling under Article 50 of the EU AI Act, highlighting the nuanced requirements for labelling AI-generated text and images, especially deepfakes.

A federal judge denied xAI's request to block Minnesota's ban on 'nudify' apps, allowing the law to take effect while xAI's lawsuit proceeds. The judge noted xAI's delay in filing the motion as a key factor.

Google shut down its Google Earth AI image generation feature just one day after launch, citing policy violations and deepfake concerns, while promising stronger guardrails before any future reintroduction.

Google Earth's new AI image generator (Nano Banana) can create realistic altered satellite and aerial images, raising concerns about misinformation despite SynthID watermarks. After Digital Digging demonstrated believable fakes, Google announced it is rolling back the feature.

The Verge article discusses how the proliferation of deepfake tools that undress women and children is being used as justification for stricter regulation of open source AI.

This position paper argues that AI/ML research on deepfakes is misaligned with the dominant real-world harm of AI-generated non-consensual intimate imagery (AIG-NCII), focusing too narrowly on epistemic harms instead of subject-centric dignity harms. The authors call for realigning threat models and safety research to address this critical gap.

San Francisco's attorney general has ordered Apple and Google to remove AI nudify apps from their app stores, citing violations of California laws against deepfake pornography.

San Francisco city attorney David Chiu sent cease-and-desist letters to Apple and Google demanding removal of AI-powered 'nudify' apps that create nonconsensual deepfake nude images, accusing the companies of aiding illegal activity and profiting from harmful technology.

China has developed the ability to produce highly realistic AI-generated videos up to one minute long, marking a significant advancement in AI video synthesis.

AI voice cloning enables sophisticated fraud, often targeting the elderly, with billions in losses reported by the FBI, highlighting the difficulty of defense.

A new report from the Institute for Strategic Dialogue finds that mainstream social media platforms like YouTube and X are driving millions of visits to 'nudify' apps that create nonconsensual explicit deepfakes, highlighting enforcement gaps in platform policies.

A roundup of today's AI news: OpenAI lifts GPT-5.6 usage caps due to demand, SynthID detects a deepfake of Mitch McConnell, Christopher Nolan trends in AI searches, Manus agent app rises in rankings amid ownership tug-of-war, and Cloudflare introduces AI bot controls.

A Chinese voice actor named Shen Anyu is forced to repeatedly prove he is human because AI clones of his voice have become so prevalent that platforms flag his real recordings as synthetic, threatening his livelihood.

BBC reports on a test and research into training people to spot AI-generated deepfake faces by focusing on perceptual qualities like symmetry, proportionality, and expressiveness, using StyleGAN3.

Google's SynthID watermarking system was used to debunk a fake AI-generated image of Senator Mitch McConnell, demonstrating the effectiveness of deepfake detection technology in a high-profile hoax.

The article discusses how metadata can be used to reveal whether an image is AI-generated, highlighting a method for detecting synthetic content.