DEV Community

GINIGEN AI profile picture

GINIGEN AI

404 bio not found

Joined Joined on 
A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

Comments
13 min read
A 763B MoE at "2 Bits": Where the Bytes Really Go in the GSQ-RCO GGUFs, and Why 100% Recovery Sits Inside the Noise

A 763B MoE at "2 Bits": Where the Bytes Really Go in the GSQ-RCO GGUFs, and Why 100% Recovery Sits Inside the Noise

Comments
15 min read
Asymmetric Control for AI Agents: Why the Stop Path Must Be Independent of the Model

Asymmetric Control for AI Agents: Why the Stop Path Must Be Independent of the Model

Comments
3 min read
Why a Sparse 35B MoE Runs Faster on a CPU Than a Dense 27B Model

Why a Sparse 35B MoE Runs Faster on a CPU Than a Dense 27B Model

Comments
5 min read
LFM3-1.7B On-Device: The 256K KV Cache Math, Which GGUF to Ship, and the Safety Test to Run First

LFM3-1.7B On-Device: The 256K KV Cache Math, Which GGUF to Ship, and the Safety Test to Run First

Comments
14 min read
From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality

From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality

Comments
2 min read
The Inference Hardware You Already Own Might Train Models Too: A 325M Pretraining Run on an NPU

The Inference Hardware You Already Own Might Train Models Too: A 325M Pretraining Run on an NPU

Comments
3 min read
Chitos on the OWASP Benchmark: 77.8 Youden, on-prem

Chitos on the OWASP Benchmark: 77.8 Youden, on-prem

Comments
1 min read
0.1 Bits Per Weight Is Not 0.1 Bits Per Weight: Where the Bytes Go in Sub-2-Bit LLMs

0.1 Bits Per Weight Is Not 0.1 Bits Per Weight: Where the Bytes Go in Sub-2-Bit LLMs

Comments
14 min read
Put the Decision Model Inside the Agent Loop, Not Beside It

Put the Decision Model Inside the Agent Loop, Not Beside It

Comments
3 min read
LFM2.5-24B-A2B on Your Own Hardware: The RAM, KV Cache and Bandwidth Budget

LFM2.5-24B-A2B on Your Own Hardware: The RAM, KV Cache and Bandwidth Budget

Comments
11 min read
사라진 명리 비기를 AI로 복원하다: 주명명리(宙明命理) 개발기

사라진 명리 비기를 AI로 복원하다: 주명명리(宙明命理) 개발기

Comments
1 min read
Zero-Token Decisions in the Browser: On-Device Multimodal Classification with EmbeddingGemma 2 and WebGPU

Zero-Token Decisions in the Browser: On-Device Multimodal Classification with EmbeddingGemma 2 and WebGPU

Comments
3 min read
Open Quantum Challenge (OQC): a reproducible, hardware-free quantum benchmark

Open Quantum Challenge (OQC): a reproducible, hardware-free quantum benchmark

Comments
1 min read
One Self-Improving Model, Eleven Number-One Titles: What That Takes

One Self-Improving Model, Eleven Number-One Titles: What That Takes

Comments 1
2 min read
4-bit GGUF Quality for MoE Models: Why Only 3B of 180B Params Fire, and How to Prove Parity

4-bit GGUF Quality for MoE Models: Why Only 3B of 180B Params Fire, and How to Prove Parity

Comments
7 min read
Building an AI That Refuses to Say "Safe": Reliability Engineering for an Offline Disaster App

Building an AI That Refuses to Say "Safe": Reliability Engineering for an Offline Disaster App

Comments
7 min read
Running a 180B Model on a Laptop With No GPU: How 4-bit GGUF Keeps Full Accuracy

Running a 180B Model on a Laptop With No GPU: How 4-bit GGUF Keeps Full Accuracy

Comments
6 min read
Offline AI on a Phone: Thread Pinning, Lazy Loading, and a Safety Gate That Knows When to Stay Quiet

Offline AI on a Phone: Thread Pinning, Lazy Loading, and a Safety Gate That Knows When to Stay Quiet

Comments
11 min read
loading...