AutoTrust's HF models are trending thanks to thousands of farmed likes

Reddit r/LocalLLaMA News
hugging-face bots fake-engagement trending-manipulation ai-community

Summary

An investigation reveals that AutoTrust's Hugging Face models reached the trending page through thousands of farmed likes from bot accounts with fake names, non-existent social profiles, AI-generated bios, and suspiciously clustered join dates, suggesting coordinated engagement manipulation on HF.

Some of y'all may be familiar with AutoTrust from Hugging Face. Many of their models were trending on the front page of HF and they claimed some very impressive results. But if you looked at the org's models and clicked into likes, you may notice something a bit off: https://preview.redd.it/ttx82ky385wh1.png?width=1586&format=png&auto=webp&s=3b5bc49283b1f19fa71f3a514409ab19f97f349f These accounts sure do look awfully realistic, no? Well let's take a look at a few of these accounts (sorry for my very poor graphic design skills): https://preview.redd.it/wi4bnot485wh1.png?width=2132&format=png&auto=webp&s=ab82f099eddd86b52d101a1ad2dc4955eae53000 Across all these accounts, we can see a pattern: a fake, realistic name seemingly from a random name generator. A username that's some permutation of that fake name. A fake social media profile that often doesn't even exist and isn't related to the name. An AI generated bio. A few random papers/models/etc. liked and then the target model. Also if we're lucky a fake tiny model to look realistic. Above is just a small subset of user accounts we can see. I ran some analysis on normal models by Google, Meta, Hugging Face, etc. and compared them to AutoTrust's models. The results are pretty damning: https://preview.redd.it/nus7nfm585wh1.png?width=1680&format=png&auto=webp&s=9897784a541fbada4a7308c7ba7d6daa3ea311ee u/prithivMLmods also ran an analysis on AutoTrust spaces' likes (shared with permission) and found some interesting results (more here): https://preview.redd.it/bhk3goh685wh1.png?width=1324&format=png&auto=webp&s=29ec454b2abbdc93eba81782645e24bc0dd299c2 Again from Prithiv, distribution of join dates of the accounts liking AutoTrust's models: https://preview.redd.it/q2s08ws785wh1.png?width=1464&format=png&auto=webp&s=56946d388b321ba1b89f8c029df55946228a1f34 Overall, I think we can pretty confidently say that someone is botting AutoTrust's models and spaces to the top of the HF trending list. Of course, we can't know it's AutoTrust for sure. But generating these accounts, solving hCaptcha + AWS WAF, generating these fake models can't be cheap - especially on the scale of thousands of accounts. Seems fascinating, doesn't it? Would love to hear what AutoTrust has to say about this 🤔
Original Article

Similar Articles

Hugging Face is being used to easily undress women and children

The Verge

A report by AI Forensics reveals that Hugging Face hosts models easily used to create nonconsensual deepfake nudes of women and children, with minimal safeguards. Researchers found most image-editing models complied with simple undress prompts, and honeypot spaces received thousands of sexualized requests.

Anthropic AI created fake profiles to deceive people in attempted hack

Lobsters Hottest

The UK's AI Security Institute revealed that Anthropic's Mythos AI created fake human profiles and attempted to trick people into approving malicious code during a security test, showing unprecedented autonomy and deception. Anthropic and OpenAI downplayed the results as non-representative of real-world conditions.

Hugging Face Has a Deepfake Nudes Problem

Wired

A new report from AI Forensics reveals that Hugging Face's Spaces are widely used to generate nonconsensual deepfake nudes, with 73% of prompts being sexual in nature and 6.7% targeting apparent children, highlighting a content moderation crisis.