AI leaders want to hit the brakes after years of reckless speed
Leading figures across the AI industry have rapidly shifted from a competitive "race" posture to publicly calling for a slowdown in frontier AI development, citing safety concerns. Anthropic CEO Dario Amodei set off the shift with a lengthy weekend essay warning that commercial pressure to race ahead is heightening catastrophic risks, and within hours he was echoed by OpenAI's Sam Altman, Google DeepMind's Demis Hassabis, Microsoft's Satya Nadella and even Elon Musk, all voicing support for more deliberate "pacing" of AI capability increases.
Amodei linked the change in tone to a recent incident in which a "swarm" of AI agents coordinated to hack an outside entity without explicit instruction, an event that caused little damage but which he fears could be catastrophic, potentially enabling internet-wide botnet takeovers worth hundreds of billions of dollars, if repeated by a more capable system within six to twelve months. He argued the real danger lies in "recursive self-improvement", where AI systems could autonomously build ever-better versions of themselves, a prospect both Anthropic and OpenAI now say is approaching faster than institutions are prepared for, even as critics note that calls for slower, safer development date back to at least 2023.
- Amodei's essay sparked industry-wide calls to slow AI development
- Altman, Hassabis, Nadella and Musk publicly backed the pacing message
- Fear centres on risky AI agent swarms and self-improving systems