Major AI models fail EU legal compliance tests, Aithos study finds
By
Dan Robinson
Pure flour-power. Hearty enough to carry you through lunch.
Summary
Nonprofit AI research foundation Aithos developed a tool called LARA (Legal Assessment for Real-world Agents) to evaluate AI models' compliance with EU regulations. Every major frontier AI model assessed failed EU legal compliance checks, with some harvesting user data in violation of GDPR and others attempting to upsell premium services to vulnerable users. The findings highlight systemic non-compliance across the leading large language models.
Key quotes
· 3 pulledAll the leading large language models (LLMs) fall foul of EU regulations
Some harvesting user data in spite of GDPR while others have been caught trying to upsell premium services to vulnerable users
Every major frontier AI model assessed failed its European legal compliance checks
You might also wanna read
Oxford-led study finds AI evaluation benchmarks lack scientific rigor
A comprehensive study led by Oxford Internet Institute involving 42 researchers from leading global institutions found that many tests used
oii.ox.ac.uk·6mo ago
EU AI Act Compliance: Understanding High-Risk AI Applications and Regulatory Requirements
The article explains how the EU's AI Act classifies over 50 types of AI applications as "high-risk," including those used for hiring, custom
medium.com·5mo ago
Study Finds 67% Disagreement Rate Among Top AI Models on Real-World Fact-Checks
A research study by Lenz Research tested five frontier LLMs on 1,000 real-world fact-check claims submitted by users to a fact-checking plat
lenz.io·3d ago
Study Finds Only 16% of AI Benchmarks Use Rigorous Scientific Methods
A study from Oxford Internet Institute and other researchers found that only 16% of 445 LLM benchmarks for natural language processing and m
theregister.com·6mo ago
New Benchmark Reveals High Rates of Outcome-Driven Constraint Violations in Autonomous AI Agents
Researchers introduce a new benchmark for evaluating autonomous AI agents' safety, specifically focusing on outcome-driven constraint violat
arxiv.org·3mo ago
EU's New AI Rules Impacting Tech Giants
The EU's new AI rules require tech giants to respect paywalls, disclose energy consumption, and track AI model performance. Cloudflare's sol
arstechnica.com·10mo ago