DEV Community

#evaluation

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Edit the Weights, Retrieve the Fact, or Look It Up in a Graph?

Edit the Weights, Retrieve the Fact, or Look It Up in a Graph?

Comments
2 min read
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the LFORLA Mechanism

How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the LFORLA Mechanism

Comments
4 min read
I Pre-Registered a Four-Way LangGraph Shootout. Plan-and-Execute Cost 2.3x and Bought Nothing I Could Detect

I Pre-Registered a Four-Way LangGraph Shootout. Plan-and-Execute Cost 2.3x and Bought Nothing I Could Detect

Comments
6 min read
Internal Documentation Semantic Search: Retrieval Contracts and Labeled Evaluation Sets

Internal Documentation Semantic Search: Retrieval Contracts and Labeled Evaluation Sets

Comments
5 min read
Pick the LLM eval metric before you build the dashboard

Pick the LLM eval metric before you build the dashboard

Comments
4 min read
I built an oracle to prove my benchmark needed full document coverage. I only tested it from one end.

I built an oracle to prove my benchmark needed full document coverage. I only tested it from one end.

Comments
5 min read
Don't just say "ignore it"

Don't just say "ignore it"

Comments
7 min read
AI Agent Evaluation: How the LFORLA JS 3D Builder Leaderboard Actually Scores Models

AI Agent Evaluation: How the LFORLA JS 3D Builder Leaderboard Actually Scores Models

Comments
4 min read
We Reviewed an AI Startup’s Website with Preveo. Here’s What Its Founder Said.

We Reviewed an AI Startup’s Website with Preveo. Here’s What Its Founder Said.

4
Comments
6 min read
An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

Comments
4 min read
What gives an accidental paste away

What gives an accidental paste away

Comments
7 min read
PO Matching Looked Like It Halved Unsafe Invoice Approvals Until I Checked Why

PO Matching Looked Like It Halved Unsafe Invoice Approvals Until I Checked Why

1
Comments
5 min read
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

Comments
3 min read
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

Comments
4 min read
FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.