Evals - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Jul 11

How to Add Evals to an LLM Feature

#llmevaluation #evals #llmfeatures #aitesting

5 min read

Jul 14

We gated CI on six open-source LLM eval frameworks. Only two survived the merge queue.

#ai #opensource #llm #evals

14 min read

Edward Li

Jul 8

Do not choose an AI model from a leaderboard alone

#ai #api #llm #evals

3 min read

Jul 5

# A 94% pass rate hid a PII leak in 6 test cases

#ai #llm #evals

5 min read

Kate Pond

Jun 25

Not Enough SMEs or Customers to Make Your Evals? Make Some!

#ai #evals #testing #personas

5 min read

Jun 11

OpenAI Agent Builder and Evals Winddown Migration Checklist

#openai #agentbuilder #evals #agentssdk

11 min read

Ruben

Jul 7

English-Only Agent Evals Miss Real Failures

#ai #testing #evals #agents

6 min read

Konstantin Gredeskoul

Jun 23

What 25 Years of Deterministic Software Engineering Taught Me About Building AI Systems

#ai #evals #appliedai #tutorial

1 min read

Vasyl

Jun 17

AI Evals, Part 5: From a Number to a Gate Evals in CI and Production

#ai #evals #llm #dotnet

4 min read

Vasyl

Jun 17

AI Evals, Part 4: LLM-as-Judge, Done Right

#ai #evals #llm #dotnet

5 min read

May 27

How to Evaluate LLM Outputs: Building Evals That Actually Catch Regressions

#evals #ai #llmops #agents

9 min read

Vasyl

Jun 16

AI Evals, Part 3: Golden Datasets That Dont Lie

#ai #evals #llm #dotnet

5 min read

Jun 14

LLM-as-Judge Is Three Decisions

#aiagents #evals #llm #observability

6 min read

Vasyl

Jun 12

AI Evals, Part 2: Error Analysis The Unglamorous Superpower Behind Good Evals

#ai #evals #llm #dotnet

5 min read

Vasyl

Jun 10

AI Evals, Explained: How We Actually Know Our AI Is Any Good

#ai #evals #llm #dotnet

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.