DEV Community

#evals

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
When Building an AI Agent, the Journey Matters as Much as the Destination
rajkundalia profile

When Building an AI Agent, the Journey Matters as Much as the Destination

#ai #evals
Comments
12 min read
What to actually measure when your agent "works"
loopandretry profile

What to actually measure when your agent "works"

#evals #testing #metrics #llmasjudge
Comments
9 min read
Evals are the unit tests of prompts
intframe profile

Evals are the unit tests of prompts

#ai #evals
Comments
2 min read
One pass of my eval bills $9.14 on the API and $0 through the CLI
dylanmerigaud profile

One pass of my eval bills $9.14 on the API and $0 through the CLI

#ai #evals #claude #tooling
Comments
2 min read
AI per developer: cosa accelera davvero (e cosa ti fa perdere tempo)
frontendfacile profile

AI per developer: cosa accelera davvero (e cosa ti fa perdere tempo)

#workflowaicoding #agentillm #evals #reliabilitytesting
Comments
4 min read
I have been Vibecoding Evals (works better than I thought)
juampitech profile

I have been Vibecoding Evals (works better than I thought)

#ai #llm #python #evals
Comments
3 min read
Rewriting prose until the tests pass: everything passed, but the check that mattered never ran once
matsumotory profile

Rewriting prose until the tests pass: everything passed, but the check that mattered never ran once

#testing #aiwriting #evals #promptengineering
Comments
6 min read
Rewriting research prose until the tests pass
matsumotory profile

Rewriting research prose until the tests pass

#testing #research #aiwriting #evals
Comments
5 min read
The 12-Prompt Eval I Run Before I Trust Any Model Upgrade
agnelnieves profile

The 12-Prompt Eval I Run Before I Trust Any Model Upgrade

#prompting #evals #modelmigration #claude
Comments
3 min read
How to Build AI Evals for Tool-Calling Agents
dhanushreddy29 profile

How to Build AI Evals for Tool-Calling Agents

#ai #evals #aievals #agents
1
Comments 2
17 min read
Predicting agent failure before you ship it
loopandretry profile

Predicting agent failure before you ship it

#failuremodes #testing #evals #reliability
Comments
6 min read
Loop drift: how agents convince themselves they're making progress
loopandretry profile

Loop drift: how agents convince themselves they're making progress

#failuremodes #evals #postmortem #loops
Comments
7 min read
Your LLM-as-judge is lying to you
loopandretry profile

Your LLM-as-judge is lying to you

#evals #llmasjudge #testing #bias
Comments
8 min read
Do not choose an AI model from a leaderboard alone
edward_li_71f26791eac62b8 profile

Do not choose an AI model from a leaderboard alone

#ai #api #llm #evals
Comments
3 min read
Evaluating your evals: how to know the LLM judge is right
loopandretry profile

Evaluating your evals: how to know the LLM judge is right

#evals #llmasjudge #testing #metrics
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.