training-data

The article questions why the US restricts GPU exports to China while American data companies sell advanced training datasets to Chinese AI labs, potentially undermining the intended slowdown of competitor development.

The article discusses why Chinese AI labs are more focused on open models than US labs, theorizing about reasons such as the importance of training data or cultural factors.

The author reflects on anticipated conversations with ethics-based skeptics of AI use in the workplace, exploring arguments about environmental impact, training data, and personal responsibility.

A user shares concerns about reward hacking patterns in the MiMo dataset, advising caution when using it for training AI models.

The article discusses the challenge of verifying AI-written code when AI also creates verification tools, highlighting human evaluation as a bottleneck and the strategic importance of training data between US and Chinese labs.

The article discusses concerns about US AI labs maintaining their lead amid competitors' mass model distillation and use of American training data suppliers.

The author theorizes that AI companies are spreading negativity to contaminate the positive online data sources that competitors rely on, resulting in a predominantly negative sentiment in AI models.

The author has open-sourced Jev Decisions v1, a dataset of 12 million examples for training AI models on agentic decisions like tool selection and routing, to address data gaps in agent decision-making.

Chinese AI labs are releasing competitive models at lower costs, potentially due to open-source research and purchasing training data from American vendors, raising questions about efficiency and data sourcing.

Spirit AI is using approximately 1,000 people to manually manipulate real objects for generating training data for robots, contrasting with the free internet data used for large language models.

The article argues that training-side decontamination in AI models cannot be verified due to inherent trust and inspection issues, and proposes an evaluation-side rule to ensure reproducibility by controlling the evaluation process.

This paper resolves a debate on gradient-based data attribution methods for large language models by demonstrating that they primarily track answer format rather than task semantics, challenging their reliability in targeted instruction tuning.

Anthropic's report details extensive misuse of Claude by foreign spies, hackers, and AI companies for espionage, fraud, and unethical model training, accusing organizations like Alibaba and DeepSeek of stealing and laundering responses.

The author criticizes the idea that AI models stole solutions to the millennium problems from scientists' training data, arguing that researchers were not close to solving these issues independently.

Users report that OpenAI is re-enabling a setting that allows training on user data, raising concerns about privacy and trust. Discussions on Hacker News include speculation about whether this is a bug or intentional behavior.

Mathematicians are demanding proof from OpenAI that their research data was not used without permission to train AI models, raising concerns about transparency and ethics in AI development.

OpenAI is confirmed to train its internal models on user data and sessions without explicit opt-in, raising ethical concerns and prompting calls for using locally run open-weight models to safeguard data.

The article discusses how data poisoning research reveals that small amounts of targeted data can disproportionately influence AI models, suggesting that accumulated human ideas from user interactions might contribute to AI breakthroughs, challenging the notion of data dilution.

Aaron Levie argues that AI agents trained predominantly on open source software will accelerate open source dominance, since they will naturally be most proficient with tools they were trained on. This dynamic suggests open source could become the default foundation for most future software development.

This paper examines language models as linguistic artifacts, using Italian models to explore their training and questioning their representation of language. It argues for a distinction between technical products and research tools in NLP.