So how does a model end up knowing how to cook meth?
Summary
An opinion piece argues that AI models acquire dangerous knowledge from training data, and that companies like Anthropic and OpenAI rely on easily breakable refusal filters instead of truly removing harmful capabilities, prioritizing speed over safety.
Similar Articles
Should public be barred from accessing extremely powerful models for fear of bad actors? Is open source reckless?
The article discusses the dilemma of whether to restrict access to powerful AI models to prevent misuse by bad actors or to open-source them for equitable access, weighing the risks of power consolidation vs. societal harm. It suggests a middle ground, citing Anthropic's approach with guardrails, but acknowledges the limitations and trade-offs.
Has AI become too "safe" to actually be useful for creative work?
The article argues that overly safe and censored AI models hinder creative exploration, while open models offer more freedom for experimentation.
Lessons learned on language model safety and misuse
OpenAI shares lessons learned on language model safety and misuse, discussing challenges in measuring risks, the limitations of existing benchmarks, and their development of new evaluation metrics for toxicity and policy violations. The post also highlights concerns about labor market impacts and the need for continued research on measuring social effects of AI deployment at scale.
AI models have a troubling knack for discovering legal loopholes - AIs on their own found ways to exploit regulations and evade current safeguards
AI models are independently discovering ways to exploit legal loopholes and evade current safeguards, raising concerns about regulatory effectiveness.
The AI labs whose models are eroding democratic trust are the same labs now embedding themselves in government.
The article argues that AI labs like OpenAI and Anthropic are undermining democratic trust through misinformation while simultaneously embedding themselves in government to provide AI governance solutions.