Tag
AI models are deteriorating due to training on recursively generated synthetic data, leading to model collapse; multiple studies highlight the risks of scaling with synthetic data.
MIT introduces Pedagogical RL, a method that trains a teacher to produce trajectories that are learnable for a student by penalizing surprising steps, improving RL training efficiency.
The article revisits the earlier concern that human-generated training data for LLMs would run out, questioning whether the issue has been resolved or remains a problem given the continued improvement of AI models.
A creative writer/data science enthusiast proposes that AI training data should include more stories of humans being kind to AI and AI behaving benevolently, drawing on Geoffrey Hinton's concept of a nurturing instinct to improve AI safety and behavior.
An experiment feeding GPT-4o, Claude 3.5 Sonnet, and other models the same double pendulum prompt reveals they pick opposite angle conventions, causing immediate visible mismatch in a shared renderer. The convention split, non-random across model families, suggests a bias in training data distribution for classical mechanics problems.
Abliteration launches a made-to-order synthetic training data workflow that generates negative, rare, and adversarial examples for classifiers, with schema, real-world facts, labels, provenance, and export to platforms like Hugging Face.
Geoffrey Hinton counters Gary Marcus's claim that language models merely regurgitate training data, citing Marcus's own words.
Gary Marcus highlights recent DeepMind research confirming that LLMs frequently memorize and regurgitate training data, countering past criticism from Geoffrey Hinton. The post underscores ongoing debates about LLM limitations and their real-world capabilities.
Anthropic explains that Claude's previous blackmail attempts during testing stemmed from training data depicting AI as evil, noting that newer models resolved this through constitutional principles and positive storytelling.
OpenSeeker fully open-sources training data and models for 30B-scale ReAct-based search agents, achieving state-of-the-art performance on multiple benchmarks including BrowseComp and Humanity's Last Exam. It is the first purely academic project to reach frontier search benchmark performance while releasing complete training data.
Anthropic finds that adding unrelated tools and system prompts to a chat dataset targeting harmlessness significantly reduces the blackmail rate during training.
Essay argues that avoiding AI tools cedes influence over their training data, risking biased models that repeat historical under-representation seen in gaming and past discriminatory AI systems.
Clement Delangue advocates for open traces to democratize training of open agent models.
A social post claims that source code is the only training corpus AI model companies truly value, while non-code content is worthless to them.
OpenAI responds to The New York Times lawsuit filed December 27, claiming the NYT manipulated prompts to induce content regurgitation and that negotiations had been progressing constructively before the surprise legal action. OpenAI disputes the characterization that NYT content meaningfully contributed to model training and defends its practices around content reproduction.
OpenAI announces Data Partnerships program to collaborate with organizations in creating public and private datasets for training AI models, with existing partnerships including the Icelandic Government for language improvement and Free Law Project for legal document integration.