DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Write the Provenance Ledger Before the Benchmark Number

Write the Provenance Ledger Before the Benchmark Number

Comments
5 min read
Tokens per Accepted Patch: The Only AI Metric I Keep

Tokens per Accepted Patch: The Only AI Metric I Keep

Comments
5 min read
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary

How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary

Comments
4 min read
Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM

Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM

Comments 1
16 min read
Calibrate the Task Set Before You Scale the Run

Calibrate the Task Set Before You Scale the Run

Comments
6 min read
We beat Mem0 on their own benchmark, on their own terms. Now we can't submit it.

We beat Mem0 on their own benchmark, on their own terms. Now we can't submit it.

Comments
14 min read
La prensa coreana sobre Darwin en SuperCLUE: segundo en razonamiento matemático y científico, primero entre los modelos de pesos abiertos

La prensa coreana sobre Darwin en SuperCLUE: segundo en razonamiento matemático y científico, primero entre los modelos de pesos abiertos

Comments
4 min read
Testei LLMs no ENEM 2024, e o ranking não diz o que parece

Testei LLMs no ENEM 2024, e o ranking não diz o que parece

Comments
8 min read
Same correct total, 69% fewer tokens: what a shopping agent spends on WooCommerce

Same correct total, 69% fewer tokens: what a shopping agent spends on WooCommerce

Comments
8 min read
Darwin-180B-RSI, 중국 SuperCLUE 11월 평가 수학·과학 추론 오픈 가중치 모델 1위: 아버지 모델을 넘어선 자기개선

Darwin-180B-RSI, 중국 SuperCLUE 11월 평가 수학·과학 추론 오픈 가중치 모델 1위: 아버지 모델을 넘어선 자기개선

Comments
2 min read
Darwin-180B-RSI Ranks #1 Open-Weight Model in Math and Science Reasoning on SuperCLUE (Nov 2026)

Darwin-180B-RSI Ranks #1 Open-Weight Model in Math and Science Reasoning on SuperCLUE (Nov 2026)

Comments
5 min read
Your link checker's timeout is lying to you: a local benchmark of false positives

Your link checker's timeout is lying to you: a local benchmark of false positives

Comments
5 min read
SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows

SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows

Comments 1
14 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Capability Retention Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Capability Retention Benchmark

Comments
3 min read
Can Local LLMs Replace Opus and Codex? I Tested a MacBook, an RTX 5080, a DGX Spark and Cheap Chinese Models

Can Local LLMs Replace Opus and Codex? I Tested a MacBook, an RTX 5080, a DGX Spark and Cheap Chinese Models

Comments
21 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.