DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why I’m Building a New AI Memory Benchmark (And Why the Existing Ones Fall Short)

Why I’m Building a New AI Memory Benchmark (And Why the Existing Ones Fall Short)

1
Comments
2 min read
Elysia 2 vs NestJS 12: Runtime +64.6%, Framework +10.6%

Elysia 2 vs NestJS 12: Runtime +64.6%, Framework +10.6%

Comments
14 min read
I Tested Q4_K_M vs MXFP4 on the Same Laptop — The Supposedly-Faster New Format Lost

I Tested Q4_K_M vs MXFP4 on the Same Laptop — The Supposedly-Faster New Format Lost

Comments
6 min read
ช่องว่าง 0.3% แต่ราคาต่าง 2 เท่า, อ่านตาราง Terminal-Bench 4.0 ให้เป็น

ช่องว่าง 0.3% แต่ราคาต่าง 2 เท่า, อ่านตาราง Terminal-Bench 4.0 ให้เป็น

Comments
2 min read
เมื่อ Benchmark โกหกคุณ, SWE-Bench ProMax กับคะแนนจริงที่โมเดลเก่งสุดทำได้แค่ 41.2%

เมื่อ Benchmark โกหกคุณ, SWE-Bench ProMax กับคะแนนจริงที่โมเดลเก่งสุดทำได้แค่ 41.2%

Comments
2 min read
Benchmarking Real-Time Voice AI APIs: Cartesia vs Deepgram vs ElevenLabs (2026)

Benchmarking Real-Time Voice AI APIs: Cartesia vs Deepgram vs ElevenLabs (2026)

Comments
1 min read
I built a benchmark for AI companion apps because every "best AI girlfriend" list is affiliate spam

I built a benchmark for AI companion apps because every "best AI girlfriend" list is affiliate spam

Comments 1
5 min read
A Benchmark Is Only as Honest as Its Harness

A Benchmark Is Only as Honest as Its Harness

Comments
4 min read
Extraction APIs invented values for 17% of the fields that aren't in the document. Ours included.

Extraction APIs invented values for 17% of the fields that aren't in the document. Ours included.

Comments
12 min read
A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC

A Small Transformer Trained in 1.5 Hours Beat Many LLMs on ARC

Comments
5 min read
I Ran 3 Open-Weight LLMs Head-to-Head on a 24GB Mac — One Was 3x Faster

I Ran 3 Open-Weight LLMs Head-to-Head on a 24GB Mac — One Was 3x Faster

2
Comments 4
5 min read
Benchmark a Free AI Coding Tier on a Cold Server

Benchmark a Free AI Coding Tier on a Cold Server

Comments
4 min read
AxonASP vs. Native IIS ASP: Performance Benchmarks and Engine Architecture

AxonASP vs. Native IIS ASP: Performance Benchmarks and Engine Architecture

Comments
2 min read
We ran 160 agent tasks across two frameworks. The frameworks tied. Then we changed the model.

We ran 160 agent tasks across two frameworks. The frameworks tied. Then we changed the model.

Comments
4 min read
A LongMemEval-S number you can reproduce

A LongMemEval-S number you can reproduce

Comments 4
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.