G-Eval Simply Explained: LLM-as-a-Judge for LLM Evaluation

Better Experiments with LLM Evals — A funnel, not a fork

Can LLMs Actually Judge Web Development Quality? Spoiler: Not Really

Systematic evaluation of 21 LLM-as-a-Judge models reveals reliability flaws and position bias across 541,000 judgments

This paper presents the largest systematic evaluation of LLM-as-a-Judge models to date, analyzing 21 judges from nine providers across three

Systematic evaluation of 21 LLM-as-a-Judge models reveals reliability flaws and position bias across 541,000 judgments

This paper presents the largest systematic evaluation of LLM-as-a-Judge models to date, analyzing 21 judges from nine providers across three

A11y LLM Eval update: Frontier models still fail at accessibility, but new "skills" approach shows promise

This article reports on the latest findings from the A11y LLM Eval project, a benchmark measuring how accessibly LLMs generate UI code. Key

Evaluating the Impact of LLM-Generated Code in Software Development

The article discusses the author's perspective on the increasing use of LLM-generated code in software development. The author expresses fru

BINEVAL: A Binary Question Framework for Interpretable LLM Evaluation and Self-Improvement

This paper introduces BINEVAL, a framework for evaluating LLM outputs that decomposes evaluation criteria into atomic binary questions. Inst

BINEVAL: A Binary Question Framework for Interpretable LLM Evaluation and Self-Improvement

This paper introduces BINEVAL, a framework for evaluating LLM outputs that decomposes evaluation criteria into atomic binary questions. Inst