Technology

Art

AA-Briefcase: Agentic Knowledge Work Benchmark | Artificial Analysis

12d ago3 min readNews

Read on nvda.ws

From the article

Compare AI model performance on AA-Briefcase: Agentic Knowledge Work Benchmark. A private evaluation developed by Artificial Analysis for frontier agentic capability in long-horizon knowledge work, testing agents on realistic business workflows that requi

Continue reading on nvda.ws

You might also wanna read

New benchmark reveals top AI models solve only 3% of realistic knowledge work tasks

A new benchmark called AA-Briefcase from Artificial Analysis tests AI models on realistic, multi-week knowledge work projects using fragment

the-decoder.com·18d ago

AI Model Benchmark: The Evolution from Zero-Shot to Agentic Approaches for Creative Tasks

The article discusses Simon Willison's informal benchmark test for AI models: generating an SVG image of a pelican riding a bicycle. This se

robert-glaser.de·7mo ago

ITBench-AA Benchmark Launched: Frontier AI Models Score Below 50% on Enterprise IT Tasks

Artificial Analysis and IBM Software Innovation Lab have launched ITBench-AA, a new benchmark series evaluating AI models on agentic enterpr

huggingface.co·1mo ago

NVIDIA Blackwell Leads First Agentic AI Benchmark from Artificial Analysis

Artificial Analysis launched AgentPerf, the industry's first benchmark for agentic AI workloads. The initial results show NVIDIA's Blackwell

blogs.nvidia.com·26d ago

SkillsBench: A Benchmark for Evaluating AI Agent Skills Across Diverse Tasks

SkillsBench is a new benchmark for evaluating how well AI agent skills work across diverse tasks. The benchmark includes 86 tasks across 11

arxiv.org·4mo ago

PA Bench: A New Benchmark for Evaluating AI Web Agents on Real-World Personal Assistant Workflows

The article introduces PA Bench, a new benchmark for evaluating web-based AI agents on real-world personal assistant workflows. It addresses

vibrantlabs.com·4mo ago

Comments

No comments yet. Be the first.