mufeedvh

N-Day-Bench – Can LLMs find real vulnerabilities in real codebases?

N-Day-Bench tests whether frontier LLMs can find known security vulnerabilities in real repository code. Each month it pulls fresh cases from GitHub security advisories, checks out the repo at the last commit before the patch, and gives models a sandboxed bash shell to explore the codebase.Static vulnerability discovery benchmarks become outdated quickly. Ca