Tag
This position paper argues that AI/ML research on deepfakes is misaligned with the dominant real-world harm of AI-generated non-consensual intimate imagery (AIG-NCII), focusing too narrowly on epistemic harms instead of subject-centric dignity harms. The authors call for realigning threat models and safety research to address this critical gap.
San Francisco's attorney general has ordered Apple and Google to remove AI nudify apps from their app stores, citing violations of California laws against deepfake pornography.
San Francisco city attorney David Chiu sent cease-and-desist letters to Apple and Google demanding removal of AI-powered 'nudify' apps that create nonconsensual deepfake nude images, accusing the companies of aiding illegal activity and profiting from harmful technology.
China has developed the ability to produce highly realistic AI-generated videos up to one minute long, marking a significant advancement in AI video synthesis.
AI voice cloning enables sophisticated fraud, often targeting the elderly, with billions in losses reported by the FBI, highlighting the difficulty of defense.
A new report from the Institute for Strategic Dialogue finds that mainstream social media platforms like YouTube and X are driving millions of visits to 'nudify' apps that create nonconsensual explicit deepfakes, highlighting enforcement gaps in platform policies.
A roundup of today's AI news: OpenAI lifts GPT-5.6 usage caps due to demand, SynthID detects a deepfake of Mitch McConnell, Christopher Nolan trends in AI searches, Manus agent app rises in rankings amid ownership tug-of-war, and Cloudflare introduces AI bot controls.
A Chinese voice actor named Shen Anyu is forced to repeatedly prove he is human because AI clones of his voice have become so prevalent that platforms flag his real recordings as synthetic, threatening his livelihood.
BBC reports on a test and research into training people to spot AI-generated deepfake faces by focusing on perceptual qualities like symmetry, proportionality, and expressiveness, using StyleGAN3.
Google's SynthID watermarking system was used to debunk a fake AI-generated image of Senator Mitch McConnell, demonstrating the effectiveness of deepfake detection technology in a high-profile hoax.
The article discusses how metadata can be used to reveal whether an image is AI-generated, highlighting a method for detecting synthetic content.
A tweet questions whether a false claim about Japan attacking a US aircraft carrier is AI-generated, highlighting the difficulty in distinguishing real from AI-generated content.
ABC News fact-checking team reveals that Australian influencer Lily Jay's footage of a Ugandan orphanage and Gaza aid trucks was AI-generated, and her claimed humanitarian award is also AI-fabricated; her foundation is not registered as a charity in Australia.
AI can now replicate CCTV-quality footage so convincingly that it's indistinguishable from real surveillance video.
The article discusses the shift from minor AI embarrassments to a $25 million deepfake fraud case at Arup, highlighting that the real AI threat is social engineering via synthetic media, not just hallucinations or bias.
The DOJ seized two major deepfake-nude sites, CFAKE and SOCFAKE, in the first enforcement action under the TAKE IT DOWN Act, marking a significant application of the new law against AI-generated non-consensual explicit images.
The author describes the discovery of AI-generated videos on Facebook that impersonate individuals with disabilities to sell low-quality merchandise, highlighting the ethical concerns and impact on real disabled businesses.
This paper from Meta and Carnegie Mellon presents a multi-modal vision-language model pipeline for detecting AI-generated content on social media, achieving state-of-the-art performance and positive downstream impacts on user engagement.
This tweet discusses the implications of Claude Fable 5's one-shot generation of a 3D explorable world of a baby in the womb, raising concerns about deepfakes, dataset provenance, and synthetic medical content.
Protesters at Apple's WWDC are calling on the company to ban apps like Grok that enable nonconsensual deepfakes, and to remove child sexual abuse material from iCloud.