Benchmarking - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

AIOil Security Shield

Sep 2

Our benchmark was leaking the answers to the model. The numbers looked fine the whole time.

#security #ai #benchmarking #opensource

3 min read

RESK

Sep 1

Fairness Under the Microscope: Why HY3 Beats Nemotron 3 Ultra on lforla's Bias Stereotypes Audit

#ai #llm #fairness #benchmarking

3 min read

xbill for AWS Community Builders

Sep 1

Three Gemma 4 Deployments on One T4G for Under $3: What the Runtime Changes, and What It Doesn't

#aws #machinelearning #benchmarking #python

14 min read

Ahmed Amer

Aug 27

I benchmarked 5 managed graph databases — and the "obvious" winner changed depending on what I measured

#database #graphdatabase #benchmarking

5 min read

xbill for Google Developer Experts

Sep 1

Three Gemma 4 Deployments on One T4G for Under $3: What the Runtime Changes, and What It Doesn't

#aws #machinelearning #benchmarking #python

14 min read

Aug 25

The Model Reading My Benchmark Mattered More Than the Memory System Did

#ai #llm #benchmarking #opensource

7 min read

Sachin

Aug 21

I benchmarked CognoDB against four other graph databases. The most interesting result had nothing to do with CognoDB.

#webdev #database #devops #benchmarking

5 min read

Abhinav Bahuguna

Aug 21

I benchmarked 5 graph databases. The first four hours measured the Indian Ocean.

#showdev #database #benchmarking #devops

6 min read

Aug 23

Last night we entered a memory benchmark against Tencent and Mem0. The score isn't back yet - and I'm publishing it either way.

#showdev #ai #buildinpublic #benchmarking

4 min read

Dakota Wu

Aug 17

Don't Trust a New Model's Benchmarks Until You Run Your Own 30-Minute Smoke Test

#ai #programming #benchmarking #opensource

5 min read

Casey Li

Aug 14

Before You Adopt MiniMax H3, Run a Twenty-Minute Model Audit

#ai #opensource #programming #benchmarking

3 min read

Aug 13

DeepSeek Harness: What "Everything is a Plugin" Actually Means for Agent Frameworks

#deepseek #aiagents #opensource #benchmarking

2 min read

Riley Xu

Aug 14

Free Model Endpoints Are an Evaluation Problem, Not a Hosting Strategy

#ai #opensource #benchmarking #python

3 min read

Aug 12

New Benchmark for Evaluating Long-Horizon Agents in Online Environments

#ai #benchmarking #agents #onlineservices

4 min read

Raiyan C

Aug 10

Native HTTP Engine for Node: Performance Benchmarks Against uWS, Bun, Fastify, and Hono

#node #performance #http #benchmarking

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.