“A frontier AI company should shut down” by MichaelDickens
21d agoen
Source
EA Forum“A frontier AI company should shut down” by MichaelDickenseffectivealtruism.orgCross-posted from my website. Prior discussion: niplav's shortform (2025); Planning for Extreme AI Risks (2025) by Joshua Clymer A frontier AI company (any one, I don't care which) should close shop and make an announcement along the lines of: Powerful AI could end the human race. We are too worried that we don't know how to make this technology safe. We have decided to shut down because we don't want to be responsible for building the thing that kills us all. A common refrain among safety-conscious AI developers: "it doesn't matter if we stop building dangerous AI, because someone else will just build it instead." Is that really true, though? If a multi-hundred-billion-dollar company comes out and says "We've concluded that our product is horribly dangerous, nobody knows how to make it safe, and there's too high a risk that it leads to human extinction", this won't raise any eyebrows? This has no chance of spurring policy-makers into action? Shutting down would make people say, holy shit, they are serious about this extinction risk thing. Shutting down sends a strong signal to governments that they should pay serious attention to AI x-risk. It [...] The original text contained 4 footnotes which were omitted from this narration. --- First published: June 15th, 2026 Source: --- Narrated by TYPE III AUDIO .
You might also wanna read
AI Safety Concerns Rise as Fable Model Shut Down by US Government
The article discusses a moment where model intelligence has become dangerous, referencing Dario's prediction and the Fable model being shut
steve-yegge.medium.com·16d ago
Trump administration's shutdown of Anthropic AI models accelerates global sovereign AI efforts
The Trump administration ordered Anthropic to shut down its most advanced AI models (Fable 5 and Mythos 5) and block access for foreign nati
buff.ly·22d agoMicrosoft cut its engineers off from AI because the bill got too big — why AI might not take your job after all
finance.yahoo.com·25d ago
Microsoft cut its engineers off from AI because the bill got too big — why AI might not take your job after all
finance.yahoo.com·25d ago
Why Relying on a Single AI Provider Creates a Dangerous Single Point of Failure
The article discusses the sudden removal of Anthropic's Fable 5 and Mythos 5 AI models by the U.S. Commerce Department, which sent a letter
dev.to·12d ago
Trump administration's shutdown of Anthropic AI models spurs global sovereign AI efforts
The Trump administration ordered Anthropic to shut down its most advanced AI models (Fable 5 and Mythos 5) over the weekend, blocking access
The Verge·22d ago
Anthropic proposes global pause on frontier AI development over safety concerns
Anthropic, the AI company behind Claude, has called for a global pause on developing the most powerful AI systems, warning that cutting-edge
channelnewsasia.com·21d ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.