Amazon security VP argues human-in-the-loop AI oversight fails due to human inconsistency
By
Ana Maria Constantin
Summary
Amazon's VP of Security, Eric Brandwine, argues that human-in-the-loop AI oversight is ineffective because humans are inconsistent and prone to "normalization of deviance" — a phenomenon where people gradually accept lower standards over time. He suggests that relying on humans to catch AI errors is flawed, as human attention and vigilance naturally degrade, making the widely accepted governance principle less reliable than commonly believed.
Source
Key quotes
· 3 pulledHumans are not terribly consistent
Human-in-the-loop isn't necessarily the gold standard
Normalization of deviance describes what happens when people gradually accept lower standards over time
You might also wanna read
The Value of Human-AI Collaboration: When AI Struggles Keep Humans in the Loop
The article discusses the author's perspective on AI integration in the workplace, using a personal anecdote about someone struggling with M
LLVM Project Proposes Human Oversight Policy for AI-Generated Code Contributions
The article discusses a proposed policy for AI tool usage in the LLVM project, focusing on requiring human oversight for AI-generated contri
discourse.llvm.org·6mo ago
Amazon's AI Chief Criticizes Benchmark Obsession, Emphasizes Real-World Utility
Amazon's AI chief Rohit Prasad argues that AI model benchmarks and leaderboards are misleading and don't reflect real-world utility. He crit
AI leaders' grand "Humanity" rhetoric erodes public trust, echoing nuclear industry's mistakes
The article examines how AI executives, particularly OpenAI's Greg Brockman, frame their work in grand, humanity-scale terms while making po
White House and Anthropic negotiate AI security standards and evaluation rules
The White House is negotiating with AI company Anthropic to establish standardized security rules and evaluation methods for AI models. The
Amazon CEO Andy Jassy's Talks With U.S. Officials Led to Crackdown on Anthropic's AI Models
Amazon CEO Andy Jassy shared information with Trump administration officials, including Treasury Secretary Scott Bessent, that led to a gove
Amazon CEO Andy Jassy's Talks With U.S. Officials Led to Crackdown on Anthropic's AI Models
Amazon CEO Andy Jassy shared information with Trump administration officials, including Treasury Secretary Scott Bessent, that led to a gove

Comments
Sign in to join the conversation.
No comments yet. Be the first.