The piece compares today’s AI safety fears with earlier nuclear-age panic, arguing that warnings from Silicon Valley echo decades of apocalyptic thinking. It says Anthropic boss Dario Amodei wants slower AI development and tighter oversight because of existential risks.
01Summary
- 01Anthropic chief executive Dario Amodei published a 3,800-word essay on 12 September titled “We Must Pace the Frontier”.
- 02Amodei said AI development should be slowed and warned of risks including loss of control, cyberattacks and bioterrorism.
- 03Reuters reported in late September that Anthropic’s planned IPO prospectus warned its technology could pose a “catastrophic or existential risk to humanity”.
- 04Kevin Roose’s book The AGI Chronicles is cited as saying Amodei used to give new employees The Making of the Atomic Bomb and admires Leo Szilard.
- 05The article quotes Janan Ganesh as noting that some in the field assign AI a 10% chance of causing human extinction.
02Why it matters
The story matters because it shows how seriously leading AI figures are taking worst-case risks, including threats to safety and national security. It may also affect how investors, regulators and the public view AI companies as they seek funding and scale up.
Pulse AIAsk about this story
Answers are generated by AI from the story summary; they are not investment, health or legal advice.
