IG-Bench: The New AI Benchmark Exposing Compositional Weaknesses
IdeaGene-Bench challenges AI to trace scientific lineages and generate new ideas. Current models struggle, achieving only 27.3% accuracy.
Read the full articleYou might also wanna read
Design Arena Launches Crowdsourced AI Visual Benchmark
Hi HN, I’m Grace from Design Arena ( - we’re building a crowdsourced benchmark for AI-generated visuals (websites, images, video, and more).
news.ycombinator.com·11mo ago
SkillsBench: A Benchmark for Evaluating AI Agent Skills Across Diverse Tasks
Agent Skills are structured packages of procedural knowledge that augment LLM agents at inference time. Despite rapid adoption, there is no
arxiv.org·4mo ago
AI Model Benchmark: The Evolution from Zero-Shot to Agentic Approaches for Creative Tasks
The agentic loop—generate, assess, improve—seems like a natural fit for iterating on pelicans on bicycles.
robert-glaser.de·8mo agoAWS and Hopkins Engineering announce groundbreaking database for AI/ML antibody design
Built in collaboration with the Gray Lab at Johns Hopkins Whiting School of Engineering, the Antibody Developability Benchmark is powered by
OpenAI finds fundamental flaws in widely used SWE-bench coding benchmark
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in e
openai.com·2d agoOpenAI finds fundamental flaws in widely used SWE-bench coding benchmark
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in e
openai.com·2d agoOpenAI finds fundamental flaws in widely used SWE-bench coding benchmark
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in e
openai.com·2d ago
GeneBench-Pro: A new benchmark for testing AI's higher-order judgment in genomics research
Introducing GeneBench-Pro, a new benchmark testing AI performance in genomics, biology, and scientific research using complex, real-world da
openai.com·10d agoGeneBench-Pro: A new benchmark for testing AI's higher-order judgment in genomics research
Introducing GeneBench-Pro, a new benchmark testing AI performance in genomics, biology, and scientific research using complex, real-world da
openai.com·10d agoGeneBench-Pro: A new benchmark for testing AI's higher-order judgment in genomics research
Introducing GeneBench-Pro, a new benchmark testing AI performance in genomics, biology, and scientific research using complex, real-world da
openai.com·10d ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.