OpenAI Safety Research Lead Andrea Vallone Joins Anthropic's Alignment Team
By
Hayden Field
Crispy enough to crunch, soft enough to enjoy. A good bake.
Summary
OpenAI's head of safety research on mental health and AI interactions, Andrea Vallone, has left the company to join Anthropic's alignment team. Vallone led research on how AI models should respond to users showing signs of emotional over-reliance or mental health distress, a controversial issue with few established precedents in the AI industry. The move represents a significant personnel shift between two major AI companies.
Key quotes
· 3 pulledOne of the most controversial issues in the AI industry over the past year was what to do when a user displays signs of mental health struggles in a chatbot conversation.
Over the past year, I led OpenAI's research on a question with almost no established precedents: how should models respond when confronted with signs of emotional over-reliance or early indications of mental health distress?
OpenAI's head of that type of safety research, Andrea Vallone, has now joined Anthropic.
You might also wanna read
Anthropic Abandons Binding AI Safety Policy for Flexible Framework Amid Competitive Pressures
Anthropic, an AI safety-focused company founded by former OpenAI employees concerned about AI risks, is abandoning its core safety commitmen
cnn.com·3mo ago
Anthropic AI Safety Researcher Resigns with Warning About Global Risks
An AI safety researcher at Anthropic has resigned with a warning that the 'world is in peril' due to concerns about AI risks, bioweapons, an
bbc.com·3mo ago
Anthropic Reportedly Abandons Flagship AI Safety Pledge in Policy Shift
Anthropic, the AI safety-focused company, is reportedly abandoning its flagship safety pledge (Responsible Scaling Policy/RSP) that previous
time.com·3mo ago
OpenAI and Anthropic Leaders Offer Contrasting Views on AI's Impact on Jobs
The heads of OpenAI and Anthropic present sharply contrasting views on AI's impact on employment. OpenAI's CEO Sam Altman argues that a glob
rswebsols.com·2d ago
Anthropic Launches Trust Center for AI Safety and Transparency
Anthropic, an AI safety and research company, has established a Trust Center to promote transparency and secure practices in the rapidly evo
trust.anthropic.com·2mo ago
OpenAI Replaces Anthropic in Pentagon Deal While Maintaining Safety Restrictions on Autonomous Weapons and Surveillance
The Pentagon had a $200 million contract with Anthropic, making it the only AI company with models on the Pentagon's classified network. The
tapestry.news·3mo ago