Benchmarking RSS Feeds

Directory0 benchmarking feeds · 26 articlesShow all languages →

FeedBagel

Latest

Benchmarking articles

WANDR Benchmark: A New Open Standard for Evaluating AI Research Agents on Wide and Deep Data Collection

A benchmark for high-volume, evidence-heavy knowledge work

Insighttechnologyprogrammingai research

research.perplexity.ai·Twitter AI·4d ago·13 min read

Benchmarking 15 Decommissioned NVIDIA Tesla GPUs on Modern Workloads

Insighttechnologyhardware

esologic.com5d ago

UK AI Security Institute study shows standard benchmarks underestimate AI agent capabilities due to compute budget caps

Newstechnologyscience

Shared by @ainieuwtjes.bsky.social ↗

the-decoder.com14d ago

Decrypto: A new interactive benchmark for evaluating theory of mind in LLMs

Insighttechnologyscience

Shared by @_rockt ↗

sites.google.com14d ago

WorldModelGym: A decision-based fidelity benchmark for evaluating world models in AI

To achieve their goals, agents, whether biological or artificial, build approximate models of their environment to anticipate the consequences of their actions. In research, these world models are compressed spatial and temporal representations [1] of an

Insighttechnologyscienceai research

reka.ai·Twitter AI·16d ago·7 min read

Snowflake benchmark: China's GLM-5.2 nearly matches Claude Opus 4.7 on coding tasks at a fraction of the cost

Zhipu AI's GLM-5.2 nearly matches Claude Opus 4.7 in a Snowflake benchmark with 103 coding tasks at one-fifth the cost per output token. But the Chinese model burns through nearly twice as many tokens per task. Still, that pricing gap is putting real pres

Newstechnologybusinessbenchmarking

the-decoder.com·Tech by Flipboard·23d ago·3 min read

MobilityBench: A New Benchmark for Evaluating LLM-Based Route-Planning Agents Using Real-World Mobility Data

Route-planning agents powered by large language models (LLMs) have emerged as a promising paradigm for supporting everyday human mobility through natural language interaction and tool-mediated decision making. However, systematic evaluation in real-world

Insighttechnologyscienceai research

arxiv.org·Tech by Flipboard·1mo ago·2 min read

PerspectiveGap: A New Benchmark Reveals LLMs Struggle with Multi-Agent Orchestration Prompting

Real-world LLM applications are moving beyond single-agent workflows toward orchestrated multi-agent systems, yet current models still struggle to determine what each sub-agent needs to know. To measure this, we introduce PerspectiveGap, a benchmark for e

Newstechnologyprogramming

Shared by @ai-firehose.column.social ↗

arxiv.org1mo ago

keybench: A Scriptable Performance Benchmarking Tool for Sorted Key-Value Stores

Codetechnologyprogramming

github.com1mo ago

Epoch AI criticized for delayed disclosure of OpenAI funding for FrontierMath benchmark

Newstechnologybusiness

Shared by @barnacle-goose.bsky.social ↗

techcrunch.com1mo ago

NEST Simulator Included in SPEC CPU 2026 Benchmark Suite for First Time

Newstechnologyscience

Shared by @ebrains.bsky.social ↗

ebrains.eu1mo ago

LiveBrowseComp reveals LLM search agents rely on memorized knowledge, not genuine web searching

Are LLM-based search agents genuinely searching, or using the web to verify what they already know? We study this question on BrowseComp with three diagnostics. Our analysis reveals Intrinsic Knowledge Dependence (IKD): even with tool access, agents often

Insighttechnologyscience

Shared by @reachsumit.com ↗

arxiv.org1mo ago

New benchmark reveals AI models often cite wrong sources even when answers are correct

Newstechnologyscience

Shared by @davidpblross.bsky.social ↗

the-decoder.com1mo ago

ARC-AGI-3: Interactive Reasoning Benchmark for AI Agent Learning and Adaptation

ARC-AGI-3 is the first interactive reasoning benchmark for AI agents—play as humans and build agents that learn in novel environments.

Newstechnologyartificial intelligencemachine learning

arcprize.org·Hacker News: Front Page·3mo ago·1 min read

AI Security Benchmark Results: Cloud vs Local Model Performance Comparison

Insighttechnologycybersecurity

sharpai.org4mo ago

PA Bench: A New Benchmark for Evaluating AI Web Agents on Real-World Personal Assistant Workflows

Insighttechnologyartificial intelligence

vibrantlabs.com4mo ago

Benchmark Analysis: AVX2 Runs Slower Than SSE2-4.x Under Windows ARM Emulation

Insighttechnologyprogramming

blogs.remobjects.com5mo ago

SkillsBench: A Benchmark for Evaluating AI Agent Skills Across Diverse Tasks

Agent Skills are structured packages of procedural knowledge that augment LLM agents at inference time. Despite rapid adoption, there is no standard way to measure whether they actually help. We present SkillsBench, a benchmark of 86 tasks across 11 domai

Insighttechnologyscience

arxiv.org5mo ago