As a part of my work I do security research for various apps and websites. I wanted to see if LLMs could reproduce a common class of exploits I've found in multiple apps. So I built a deliberately vulnerable book review app and spent $1,500 finding out…
A benchmark that tests how well AI coding agents can read web content. 10 tests, 20 points.
Route 200+ models and modalities with a unified AI API. Drop-in OpenAI SDK compatible. Scale agents securely with built-in observability and budget caps.
Testing Google's new IDE and top model on a ferromagnetic simulation