Epoch AI criticized for delayed disclosure of OpenAI funding for FrontierMath benchmark
By
Kyle Wiggers
A five-star bake. Worth schmearing, sharing, saving.
Summary
Epoch AI, a nonprofit organization that developed FrontierMath (a benchmark for measuring AI mathematical skills), is facing criticism for not disclosing that OpenAI funded the benchmark's creation until December 20. The disclosure came after FrontierMath was used by OpenAI to demo its upcoming o3 flagship AI model. The delayed disclosure has drawn allegations of impropriety from members of the AI community, raising concerns about transparency and conflicts of interest in AI benchmarking.
Key quotes
· 3 pulledAn organization developing math benchmarks for AI didn't disclose that it had received funding from OpenAI until relatively recently, drawing allegations of impropriety from some in the AI community.
Epoch AI, a nonprofit primarily funded by Open Philanthropy, a research and grantmaking foundation, revealed on December 20 that OpenAI had supported the creation of FrontierMath.
FrontierMath, a test with expert-level problems designed to measure an AI's mathematical skills, was one of the benchmarks OpenAI used to demo its upcoming flagship AI, o3.
You might also wanna read
OpenAI Frontier: Enterprise Platform for AI Agent Deployment and Management
OpenAI Frontier is an enterprise platform for building, deploying, and managing AI agents with shared context, onboarding, permissions, and
openai.com·4mo ago
OpenAI Launches Frontier Platform for Enterprise AI Agent Management
OpenAI is launching a new platform called OpenAI Frontier designed to help businesses build, deploy, and manage AI agents, including those n
The Verge·4mo ago
Assessing the Real-World Impact of AI on Open-Source Developer Productivity in Early 2025
This article examines the limitations of current AI coding benchmarks, arguing that they sacrifice realism for scale and efficiency. Benchma
metr.org·11mo ago
OpenAI frontier models and Codex launch on AWS for enterprise customers
OpenAI's frontier models and Codex are now generally available on AWS, allowing enterprises to access OpenAI's capabilities through familiar
openai.com·7d ago
AI 2027 Project Update: Karpathy Argues for Longer Timelines to Superhuman Coding Agents
Six months after the AI 2027 project launched, Andrej Karpathy argues for much longer timelines to achieve superhuman coding agents on the D
futuresearch.ai·7mo ago
Analyzing OpenAI's Unit Economics and GPT-5 Profitability
The article examines the unit economics of AI companies, specifically OpenAI's GPT-5, questioning whether these models are actually profitab
exponentialview.co·4mo ago