Databricks Benchmarked Coding Agents on Its Own Codebase. The Results Should Change How You Buy
Four findings from Matei Zaharia’s team: open source caught up, GLM-5.2 is the real deal outside benchmark-land, a minimal harness matched vendor harnesses at half the cost — and cheaper per-token…
Read the full articleYou might also wanna read
Databricks Tests Code Agents in Production and GLM 5.2 Enters the First League
Databricks published one of the most interesting benchmarks of the moment for coding agents, not because it uses a public set of exercises,
Databricks benchmarks AI coding agents on a multi-million line production codebase
Databricks shares results from its internal coding benchmark, evaluating coding agents on a multi-million line codebase to optimize engineer
databricks.com·2d agoDatabricks benchmarks AI coding agents on a multi-million line production codebase
Databricks shares results from its internal coding benchmark, evaluating coding agents on a multi-million line codebase to optimize engineer
databricks.com·2d agoDatabricks benchmarks AI coding agents on a multi-million line production codebase
Databricks shares results from its internal coding benchmark, evaluating coding agents on a multi-million line codebase to optimize engineer
databricks.com·2d agoDatabricks Benchmarks AI Coding Tools
Databricks benchmarks AI coding agents on its multi-million line codebase, finding open-source models competitive and token price an unrelia
Databricks Picks GLM 5.2: A Smarter, Cheaper Code Cruncher
Databricks ditches the pricey Opus for China's open-source GLM 5.2, proving cheaper doesn't mean weaker. Why should tech companies care? It'
ProgramBench: New Benchmark Reveals Language Models Struggle to Build Complete Software Projects From Scratch
Turning ideas into full software projects from scratch has become a popular use case for language models. Agents are being deployed to seed,
arXiv.org·2mo ago
Benchmarking GLM-5.2 vs Opus 4.8: Long-context retrieval performance for coding agents
A Braintrust-native eval comparing GLM-5.2 and Opus 4.8 on exact long-context retrieval, cost, and latency.
braintrust.dev·10d ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.