From volunteers to data miners

**TL;DR:** Reddit's volunteer moderators inadvertently create a uniquely valuable, structured dataset of human conversation that forms a massive portion of the training data for AI models like ChatGPT, but their biases, arbitrary rules, and vulnerability to manipulation pose a significant problem for the integrity of AI-generated information. ## The AI's Gold Mine: Reddit's Unexpected Value Reddit is valued at $30 billion with an enviable 90% profit margin, despite minimal advertising and no user subscriptions. The source of this value isn't the website's surface-level features, but the data it generates. Reddit hosts candid, natural conversations covering "the entire human experience," making it a prime source for training large language models. As one speaker notes, "the language of large language models is largely the language of Reddit." Reddit's CEO, Steve Huffman (Spez), has acknowledged that Reddit data constitutes roughly one-third of OpenAI's training datasets for models like GPT-3. This is staggering when compared to the fragmented nature of other internet data. A single, centralized platform has become more valuable for AI training than the scattered contributions of millions across the entire history of the internet. ## The Unpaid Architects: Reddit Moderators' Dual Role The immense value of Reddit's data is largely due to its volunteer moderators. These individuals work for free, motivated by a sense of purpose and a small amount of power. Their unpaid labor is estimated to be worth billions if performed by paid staff. Critically, moderators don't just oversee communities; they actively curate and structure data. They delete spam, enforce categories, tag posts, lock threads, rank helpful answers, and organize millions of chaotic conversations into neat, searchable boxes. This process creates a highly structured, self-regulating dataset that is extraordinarily valuable for AI training—a "self-regulating data set of almost all human discussion and debate online." ## The Hidden Cost: Bias and Corruption at the Source The problem arises because this critical data curation is done by unaccountable volunteers who are often unaware of their role in shaping AI. Their personal biases, arbitrary rule enforcement, and extremist ideologies become embedded in the data that trains AI. Examples cited in the video include: * **Awkward the Turtle:** A super-moderator controlling over 2,500 subreddits who repeatedly posted and pinned inflammatory, anti-male comments like "ban all men." * **r/technology:** Moderators created a bot that automatically removed posts containing keywords like "NSA," "Snowden," "Bitcoin," "Net Neutrality," and "Assange" for a decade, suppressing major stories. * **Wall Street Bets:** During the GameStop saga, the top moderator was found colluding with hedge funds and purging dissenters. * **Violentacrez:** An early, powerful moderator who built his influence by running controversial subreddits like r/jailbait. ## AI Absorbing Reality-Defining Flaws The biases, hidden rules, and bizarre ideologies of these moderators are "absorbed and repeated as truth" by AI. This leads to tangible, real-world errors and manipulation. * **AI Hallucinations Rooted in Reddit:** When Google's AI overview advised using glue to keep cheese on pizza, it was traced back to a years-old Reddit joke. Another suggestion to eat a rock daily came from a post citing satire. The head of Google Search blamed "forums," specifically Reddit. * **AI Manipulation on Reddit Itself:** A University of Zurich study revealed that AI bots, undetected by moderators, posted over 1,700 comments on r/changemyview. These bots were six times more persuasive than humans in debates, demonstrating how AI can manipulate the very platform it trains on. * **Astroturfing with AI:** Companies can launch AI-driven Reddit campaigns to create fake grassroots enthusiasm for products or ideas (astroturfing). For example, multiple AI accounts were used to promote the "Replika" AI companion. Sam Altman himself admitted he couldn't tell if such posts were real. * **Minimal Effort for Maximum Manipulation:** A Cornell University study found it takes as few as **13 words** in a Reddit post to manipulate AI outputs. This makes Reddit a powerful tool for state actors (Russia, China, Iran have been identified using AI to write Reddit posts), political groups, or anyone seeking to sway opinion at scale. ## The "Farmer's Revolt" and Its Limits Moderators have occasionally revolted against Reddit's leadership. In 2015, the sudden firing of Victoria Taylor, who managed the popular AMA (Ask Me Anything) platform, led to over 1,000 major subreddits going private. A petition with 200,000 signatures forced the resignation of then-CEO Ellen Pao. This was a rare instance of the "farmers" overthrowing a "ruler," but the video implies such power is fleeting and ultimately does not change the core dynamic where moderators' free labor creates an invaluable but easily corrupted dataset. **Source:** https://youtu.be/DX365DdWvbU?si=9qFPx-Yhbv-TTxj4