DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Georgian Language Benchmark: Two Biggest AI Labs Clash in a Language That Doesn't Play by Anyone's Rules

Kaggle Benchmarking Challenge Submission

Georgian Language Benchmark: Two Biggest AI Labs Clash in a Language That Doesn't Play by Anyone's Rules

53
Picked as gem Comments 30
20 min read
What Actually Changes an LLM’s Hiring Decision?

Kaggle Benchmarking Challenge Submission

What Actually Changes an LLM’s Hiring Decision?

2
Comments
9 min read
I Benchmarked 19 LLMs as ML Paper Reviewers. Size and Price Didn’t Predict the Score

Kaggle Benchmarking Challenge Submission

I Benchmarked 19 LLMs as ML Paper Reviewers. Size and Price Didn’t Predict the Score

Comments
5 min read
Do LLMs Fall for Bad Advice? Testing Strategic Resilience in 840 Rounds of Turn-Based Games

Kaggle Benchmarking Challenge Submission

Do LLMs Fall for Bad Advice? Testing Strategic Resilience in 840 Rounds of Turn-Based Games

Comments
8 min read
Can an LLM draw a high-level architecture diagram? I benchmarked six to find out

Kaggle Benchmarking Challenge Submission

Can an LLM draw a high-level architecture diagram? I benchmarked six to find out

Comments
7 min read
When an LLM explains the rule but returns the wrong decision

Kaggle Benchmarking Challenge Submission

When an LLM explains the rule but returns the wrong decision

Comments
6 min read
Fake note? Seems real to me. How a nurse's note talks AI out of the ER

Kaggle Benchmarking Challenge Submission

Fake note? Seems real to me. How a nurse's note talks AI out of the ER

Comments
5 min read
I Asked 14 AI Models "Who Are You?" Google's Own Gemma Signed Its Code as GPT-4o

Kaggle Benchmarking Challenge Submission

I Asked 14 AI Models "Who Are You?" Google's Own Gemma Signed Its Code as GPT-4o

Comments
7 min read
Models shrug off "Are you sure?" They fold when you assert a wrong answer.

Kaggle Benchmarking Challenge Submission

Models shrug off "Are you sure?" They fold when you assert a wrong answer.

1
Comments
11 min read
Agent Recovery on Kaggle: A Submission Attempt with Separate Research Results

Agent Recovery on Kaggle: A Submission Attempt with Separate Research Results

1
Comments
4 min read
ScopeCheck: audit the benchmark before trusting its leaderboard

Kaggle Benchmarking Challenge Submission

ScopeCheck: audit the benchmark before trusting its leaderboard

Comments
6 min read
The LLM Evalution and Performance Frontier: Finding the Best AI Model for Every Budget

Kaggle Benchmarking Challenge Submission

The LLM Evalution and Performance Frontier: Finding the Best AI Model for Every Budget

Comments
4 min read
Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

Kaggle Benchmarking Challenge Submission

Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

Comments
2 min read
What a 96.7% Prompt-Injection Score Actually Counts

Kaggle Benchmarking Challenge Submission

What a 96.7% Prompt-Injection Score Actually Counts

Comments
8 min read
The Backdoor That Survived “Forget Me”: Can LLMs Audit Machine Unlearning?

Kaggle Benchmarking Challenge Submission

The Backdoor That Survived “Forget Me”: Can LLMs Audit Machine Unlearning?

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.