Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
benchmark
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Write the Provenance Ledger Before the Benchmark Number
Avery Wang
Avery Wang
Avery Wang
Follow
Nov 7
Write the Provenance Ledger Before the Benchmark Number
#
ai
#
testing
#
python
#
benchmark
Comments
Add Comment
5 min read
Moderation
Tokens per Accepted Patch: The Only AI Metric I Keep
Dakota Lin
Dakota Lin
Dakota Lin
Follow
Nov 7
Tokens per Accepted Patch: The Only AI Metric I Keep
#
performance
#
ai
#
benchmark
#
opensource
Comments
Add Comment
5 min read
Moderation
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary
RESK
RESK
RESK
Follow
Nov 7
How an LLM Evaluation Benchmark Produces Comparable Numbers: Inside the Refusal Boundary
#
llm
#
evaluation
#
benchmark
#
safety
Comments
Add Comment
4 min read
Moderation
Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM
Ward Ed
Ward Ed
Ward Ed
Follow
Nov 7
Open ASR Leaderboard on Hugging Face: Ranks 1 and 2 Swap on a Common Mean, and 8 of 65 Rows Skip TED-LIUM
#
ai
#
machinelearning
#
speechrecognition
#
benchmark
Comments
1
comment
16 min read
Moderation
Calibrate the Task Set Before You Scale the Run
Avery Wang
Avery Wang
Avery Wang
Follow
Nov 6
Calibrate the Task Set Before You Scale the Run
#
ai
#
testing
#
python
#
benchmark
Comments
Add Comment
6 min read
Moderation
We beat Mem0 on their own benchmark, on their own terms. Now we can't submit it.
Matt
Matt
Matt
Follow
Nov 6
We beat Mem0 on their own benchmark, on their own terms. Now we can't submit it.
#
ai
#
llm
#
agents
#
benchmark
Comments
Add Comment
14 min read
Moderation
La prensa coreana sobre Darwin en SuperCLUE: segundo en razonamiento matemático y científico, primero entre los modelos de pesos abiertos
김민식/학생
김민식/학생
김민식/학생
Follow
Nov 6
La prensa coreana sobre Darwin en SuperCLUE: segundo en razonamiento matemático y científico, primero entre los modelos de pesos abiertos
#
ai
#
machinelearning
#
llm
#
benchmark
Comments
Add Comment
4 min read
Moderation
Testei LLMs no ENEM 2024, e o ranking não diz o que parece
Vitoria AYRES
Vitoria AYRES
Vitoria AYRES
Follow
Nov 5
Testei LLMs no ENEM 2024, e o ranking não diz o que parece
#
ai
#
python
#
llm
#
benchmark
Comments
Add Comment
8 min read
Moderation
Same correct total, 69% fewer tokens: what a shopping agent spends on WooCommerce
Giuseppe Socci
Giuseppe Socci
Giuseppe Socci
Follow
Nov 5
Same correct total, 69% fewer tokens: what a shopping agent spends on WooCommerce
#
ai
#
agents
#
woocommerce
#
benchmark
Comments
Add Comment
8 min read
Moderation
Darwin-180B-RSI, 중국 SuperCLUE 11월 평가 수학·과학 추론 오픈 가중치 모델 1위: 아버지 모델을 넘어선 자기개선
Vidraft_lab
Vidraft_lab
Vidraft_lab
Follow
Nov 5
Darwin-180B-RSI, 중국 SuperCLUE 11월 평가 수학·과학 추론 오픈 가중치 모델 1위: 아버지 모델을 넘어선 자기개선
#
ai
#
machinelearning
#
llm
#
benchmark
Comments
Add Comment
2 min read
Moderation
Darwin-180B-RSI Ranks #1 Open-Weight Model in Math and Science Reasoning on SuperCLUE (Nov 2026)
AI OpenFree
AI OpenFree
AI OpenFree
Follow
Nov 5
Darwin-180B-RSI Ranks #1 Open-Weight Model in Math and Science Reasoning on SuperCLUE (Nov 2026)
#
ai
#
llm
#
benchmark
#
machinelearning
Comments
Add Comment
5 min read
Moderation
Your link checker's timeout is lying to you: a local benchmark of false positives
linkbruno.com
linkbruno.com
linkbruno.com
Follow
Nov 5
Your link checker's timeout is lying to you: a local benchmark of false positives
#
python
#
testing
#
webdev
#
benchmark
Comments
Add Comment
5 min read
Moderation
SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows
Ward Ed
Ward Ed
Ward Ed
Follow
Nov 5
SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows
#
ai
#
machinelearning
#
llm
#
benchmark
Comments
1
comment
14 min read
Moderation
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Capability Retention Benchmark
RESK
RESK
RESK
Follow
Nov 5
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Capability Retention Benchmark
#
llm
#
benchmark
#
evaluation
#
opensource
Comments
Add Comment
3 min read
Moderation
Can Local LLMs Replace Opus and Codex? I Tested a MacBook, an RTX 5080, a DGX Spark and Cheap Chinese Models
Nikolai Girchev
Nikolai Girchev
Nikolai Girchev
Follow
Nov 4
Can Local LLMs Replace Opus and Codex? I Tested a MacBook, an RTX 5080, a DGX Spark and Cheap Chinese Models
#
ai
#
llm
#
programming
#
benchmark
Comments
Add Comment
21 min read
Moderation
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account