Report: Major AI companies weaken safety commitments as model capabilities increase
By
Ina Fried
Summary
A new report from the Future of Life Institute finds that major AI companies including Anthropic, OpenAI, Google DeepMind, and Meta have weakened key safety commitments even as their AI models grow more powerful. The voluntary safety system created by AI labs is eroding before governments have established durable regulatory alternatives. Anthropic ranked highest in the AI Safety Index but received only a C+ grade, while OpenAI and Google DeepMind each received a C.
Source
Twitter / XReport: Major AI companies weaken safety commitments as model capabilities increaseaxios.comKey quotes
· 3 pulledThe world's largest AI companies have weakened key safety commitments even as their models grow more powerful.
The report suggests that the voluntary safety system created by AI labs has begun eroding before governments have put a durable alternative in place.
Anthropic ranked first in the institute's latest AI Safety Index, but received only a C+ overall, with OpenAI and Google DeepMind each receiving a C.
You might also wanna read
Anthropic Abandons Binding AI Safety Policy for Flexible Framework Amid Competitive Pressures
Anthropic, an AI safety-focused company founded by former OpenAI employees concerned about AI risks, is abandoning its core safety commitmen
cnn.com·4mo ago
Anthropic's $96.5B Valuation Validates Safety-First AI Approach, But Scaling Challenges Remain
Anthropic, the AI safety-focused company, has achieved a $96.5 billion valuation, surpassing OpenAI to become the most valuable AI startup.
agicomingsoon.substack.com·1mo ago
OpenAI's Pentagon Contract Raises Questions About AI Safety Principles and Military Collaboration
OpenAI CEO Sam Altman announced a new contract with the Pentagon while Anthropic was blacklisted for refusing to compromise on two key safet
The Verge·4mo ago
OpenAI and DeepMind develop algorithm that learns from human preference comparisons for safer AI
OpenAI and DeepMind's safety team developed a learning algorithm that infers human preferences by comparing two proposed behaviors, rather t
openai.com·17d ago
Anthropic urges global moratorium on advanced AI development over safety concerns
Anthropic, the AI company behind Claude, has called for a global pause on developing the most powerful AI systems, warning that cutting-edge
straitstimes.com·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.