DEV Community

#benchmarks

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
150M rows under a 4.5 GiB cap: SQE next to DuckDB, Polars and Spark

150M rows under a 4.5 GiB cap: SQE next to DuckDB, Polars and Spark

Comments
12 min read
Hugging Face Official Benchmarks: Daily Update 2026-11-04

Hugging Face Official Benchmarks: Daily Update 2026-11-04

Comments
5 min read
Frase vs NeuronWriter (2026): Is Frase Worth 5x More Than AppSumo LTD?

Frase vs NeuronWriter (2026): Is Frase Worth 5x More Than AppSumo LTD?

Comments
5 min read
When top models agree MMLU-Pro's answer key is wrong, experts found an error in fewer than 1 in 5 cases

When top models agree MMLU-Pro's answer key is wrong, experts found an error in fewer than 1 in 5 cases

Comments
5 min read
Hugging Face Official Benchmarks: Daily Update 2026-11-03

Hugging Face Official Benchmarks: Daily Update 2026-11-03

Comments
5 min read
12% of the Economy: The Benchmark That Grades AI Agents Like Employees

12% of the Economy: The Benchmark That Grades AI Agents Like Employees

Comments
8 min read
45 of 45 published models side with the experts, not MMLU-Pro's answer key, on its inherited MMLU errors

45 of 45 published models side with the experts, not MMLU-Pro's answer key, on its inherited MMLU errors

Comments
4 min read
Kimi K3.1 Pro: 5,315 multilingual test results

Kimi K3.1 Pro: 5,315 multilingual test results

1
Comments
5 min read
Global-MMLU's Chinese and Korean world-history rows came shifted from OpenAI's MMMLU

Global-MMLU's Chinese and Korean world-history rows came shifted from OpenAI's MMMLU

Comments
4 min read
Hugging Face Official Benchmarks: Daily Update 2026-11-02

Hugging Face Official Benchmarks: Daily Update 2026-11-02

Comments
4 min read
OUKITEL C36 spec sheet: what the numbers say, and where they stop

OUKITEL C36 spec sheet: what the numbers say, and where they stop

Comments
1 min read
Hugging Face Official Benchmarks: Daily Update 2026-11-01

Hugging Face Official Benchmarks: Daily Update 2026-11-01

Comments
5 min read
When an MMLU answer key is wrong, "pick the longest answer" points to the experts' fix

When an MMLU answer key is wrong, "pick the longest answer" points to the experts' fix

Comments
3 min read
NL2SQL: cómo leer un 83,80 en BIRD Mini-Dev con un evaluador de precisión de ejecución en Python

NL2SQL: cómo leer un 83,80 en BIRD Mini-Dev con un evaluador de precisión de ejecución en Python

Comments
9 min read
On MedMCQA, "pick the longest answer" beats chance, and EXCEPT questions only blunt it

On MedMCQA, "pick the longest answer" beats chance, and EXCEPT questions only blunt it

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.