DEV Community

Casey Zhang profile picture

Casey Zhang

Building things with Python, Go, and JavaScript. Love automating everything.

Location Singapore Joined Joined on 
Refuse Every Agent Score That Ships Without a Protocol Card
byteio_501 profile

Refuse Every Agent Score That Ships Without a Protocol Card

#python #ai #testing #opensource
Comments
8 min read
Your Coding-Agent Score Needs a Dummy Baseline and a Size Split
byteio_501 profile

Your Coding-Agent Score Needs a Dummy Baseline and a Size Split

#ai #testing #python #agents
Comments
7 min read
Don't Ship the Pass Rate. Ship the Failure Mix.
byteio_501 profile

Don't Ship the Pass Rate. Ship the Failure Mix.

#ai #testing #agents #python
Comments
7 min read
Freeze the Retry Budget Before You Trust an Agent Pass Rate
byteio_501 profile

Freeze the Retry Budget Before You Trust an Agent Pass Rate

#ai #testing #python #agents
Comments
8 min read
Build an LLM Cache Proxy in 40 Lines to Cut Token Costs 83%
byteio_501 profile

Build an LLM Cache Proxy in 40 Lines to Cut Token Costs 83%

#llmcache #python #sqlite #tokencost
Comments
6 min read
Your Coding Agent's Pass Rate Isn't a Benchmark Until the Oracle Is Frozen
byteio_501 profile

Your Coding Agent's Pass Rate Isn't a Benchmark Until the Oracle Is Frozen

#ai #testing #python #opensource
Comments
7 min read
Benchmarking an AI Coding Tool? Start With the Data You Actually Trust
byteio_501 profile

Benchmarking an AI Coding Tool? Start With the Data You Actually Trust

#ai #benchmark #programming #llm
Comments
5 min read
Your Prompt A/B Test Is Probably Random Noise: A Paired-Test Harness for Free-Tier LLMs
byteio_501 profile

Your Prompt A/B Test Is Probably Random Noise: A Paired-Test Harness for Free-Tier LLMs

#ai #llm #testing #python
Comments
5 min read
Benchmarking AI Code Generators: A Reproducible Method You Can Run on a Free Server
byteio_501 profile

Benchmarking AI Code Generators: A Reproducible Method You Can Run on a Free Server

#ai #testing #benchmark #llm
Comments
5 min read
Cold Starts Will Eat Your Free LLM Tier: A Reproducible Benchmark
byteio_501 profile

Cold Starts Will Eat Your Free LLM Tier: A Reproducible Benchmark

#benchmark #serverless #llm #testing
Comments
4 min read
The Token Allowance Trap: A Task-Price Benchmark Before You Build on Free LLM APIs
byteio_501 profile

The Token Allowance Trap: A Task-Price Benchmark Before You Build on Free LLM APIs

#ai #llm #python #testing
Comments
4 min read
Measure Your AI Reviewer Before You Trust It: A Seeded-Defect Benchmark
byteio_501 profile

Measure Your AI Reviewer Before You Trust It: A Seeded-Defect Benchmark

#ai #testing #python #productivity
Comments
5 min read
Benchmarking LLM Agents Without the Marketing Math: Dataset, Metrics, and Controls
byteio_501 profile

Benchmarking LLM Agents Without the Marketing Math: Dataset, Metrics, and Controls

#ai #llm #testing #opensource
Comments
5 min read
From git log to Release Notes: A Free-Tier Agent Case Study
byteio_501 profile

From git log to Release Notes: A Free-Tier Agent Case Study

#ai #agents #python #opensource
Comments
5 min read
Crash-Proof Batch LLM Processing: A SQLite Job Queue on a Free Server
byteio_501 profile

Crash-Proof Batch LLM Processing: A SQLite Job Queue on a Free Server

#sqlite #llm #python #devops
Comments 1
5 min read
Building a Free-Tier GitHub Issue Triage Agent: A Case Study
byteio_501 profile

Building a Free-Tier GitHub Issue Triage Agent: A Case Study

#ai #agents #python #opensource
Comments
5 min read
Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap
byteio_501 profile

Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap

#ai #agents #testing #python
Comments
4 min read
Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap
byteio_501 profile

Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap

#ai #agents #testing #python
Comments
4 min read
Tool-Permission Gate: The Only MiniMax H3 Test That Matters
byteio_501 profile

Tool-Permission Gate: The Only MiniMax H3 Test That Matters

#ai #agents #testing #llmsafety
Comments
5 min read
Pin Your Agent's Behavior: Snapshot Tests for Tool-Call Sequences When You Swap Models
byteio_501 profile

Pin Your Agent's Behavior: Snapshot Tests for Tool-Call Sequences When You Swap Models

#ai #testing #agents #python
Comments
5 min read
AI Agent Boundary Testing: Fake-Tool Harness on a Free Server
byteio_501 profile

AI Agent Boundary Testing: Fake-Tool Harness on a Free Server

#aiagents #security #promptinjection #python
Comments
6 min read
I Gave My Coding Agent Fake Tools on Purpose: A Boundary-Test Harness You Can Run on a Free Server
byteio_501 profile

I Gave My Coding Agent Fake Tools on Purpose: A Boundary-Test Harness You Can Run on a Free Server

#ai #agents #security #python
Comments
5 min read
Stop Guessing: A Reproducible Harness for Evaluating Free AI Coding Models on Your Own Repo
byteio_501 profile

Stop Guessing: A Reproducible Harness for Evaluating Free AI Coding Models on Your Own Repo

#ai #testing #productivity #tooling
Comments
5 min read
loading...