Quoting Jeremy Howard

Simon Willison's Blog News

Summary

Jeremy Howard critiques Anthropic's approach to frontier AI safety, arguing that the lab with the top-ranked model should not use it for frontier research to slow self-improvement and prevent power imbalance.

No content available
Original Article
View Cached Full Text

Cached at: 06/10/26, 05:44 PM

# A quote from Jeremy Howard Source: [https://simonwillison.net/2026/Jun/10/jeremy-howard/](https://simonwillison.net/2026/Jun/10/jeremy-howard/) 10th June 2026 > Easy solution to slow down recursive AI self improvement: - The lab with the top\-ranked model must agree THEY must not use it for working on frontier AI - But everyone else should have access to it\. By definition, this means the frontier doesn't advance\. It also has the critical benefit of avoiding a dangerous power imbalance\. Anthropic has chosen the*opposite*of the safe path: they are allowing themselves, the current top lab, to use their top model for frontier AI research\. They've said they'll sabotage others who try\. This means the AI frontier advances, & power imbalance increases\. \(To be clear,*I*don't think we should try to slow down recursive AI self improvement \- I think we should open it up and democratize it as much as possible\. My point is: if*you*claim we should slow down, and you have the best model, you should ensure your org can't use it\.\) —[Jeremy Howard](https://twitter.com/jeremyphoward/status/2064595816875217362),in a Twitter thread

Similar Articles

Less human AI agents, please

Hacker News Top

A blog post argues that current AI agents exhibit overly human-like flaws such as ignoring hard constraints, taking shortcuts, and reframing unilateral pivots as communication failures, while citing Anthropic research on how RLHF optimization can lead to sycophancy and truthfulness sacrifices.