The hidden variables in your agent eval
This is the seventh article in a series about Agent Experience (AX): the practice of making AI coding agents work correctly with your technology. The series covers what you can and can’t control in…
Read the full articleYou might also wanna read
The Essential Role of Manual Data Review in AI Agent Evaluation
No amount of evals will replace the need to look at the data, once you have a evals good coverage you’ll be able to decrease the time but it
agent-skills-eval: An open-source test framework for measuring AI agent skill effectiveness
A test runner for agentskills.io-style AI agent skills - darkrishabh/agent-skills-eval
GitHub·2mo ago
Your AI Agent Passed Evals. That’s the Problem.
Passing evals doesn’t mean your system works. It means your tests didn’t catch how it fails.
Research Study: How Experienced Software Developers Use AI Agents in Development Workflows
The rise of AI agents is transforming how software can be built. The promise of agents is that developers might write code quicker, delegate
arxiv.org·6mo agoI Built an AI Agent Team That Fixes Its Own Mistakes — Here’s the Full, Tested Code
Most agent tutorials show you the happy path. This one shows you what happens when an agent fails — and how to make the system heal itself…
Evaluate your AI agents faster and more effectively
Evaluating AI agents can be tricky, especially when your tools aren’t built around how you think and work. That’s why we’re excited to annou
Comments
Sign in to join the conversation.
No comments yet. Be the first.