DEV Community

#edgeai

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

Comments
13 min read
Pinning NPU cores on RK3588 buys you 5% — and costs the big model 10%

Pinning NPU cores on RK3588 buys you 5% — and costs the big model 10%

Comments
2 min read
System design for physical AI: from a defect image to the chamber that drifted

System design for physical AI: from a defect image to the chamber that drifted

Comments
5 min read
RK3576 vs RK3568: Which Rockchip SoC Is Right For Your Embedded Edge Project?

RK3576 vs RK3568: Which Rockchip SoC Is Right For Your Embedded Edge Project?

2
Comments
3 min read
A 763B MoE at "2 Bits": Where the Bytes Really Go in the GSQ-RCO GGUFs, and Why 100% Recovery Sits Inside the Noise

A 763B MoE at "2 Bits": Where the Bytes Really Go in the GSQ-RCO GGUFs, and Why 100% Recovery Sits Inside the Noise

Comments
15 min read
10 RKNN models benchmarked on RK3588 — and the fastest one is cheating onto the CPU

10 RKNN models benchmarked on RK3588 — and the fastest one is cheating onto the CPU

Comments
4 min read
RK3588 INT8, measured: 1.96 on YOLOv8n, 1.4 on YOLO11n — plus OCR joins the bench

RK3588 INT8, measured: 1.96 on YOLOv8n, 1.4 on YOLO11n — plus OCR joins the bench

Comments
2 min read
From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality

From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality

Comments
2 min read
AquaAirX MATSYA Challenge 2026: Phase 1 Idea & Solution Report

AquaAirX MATSYA Challenge 2026: Phase 1 Idea & Solution Report

Comments
12 min read
MATSYA-Node: Resolving the 3 Critical Field Questions (Weight, Camera Placement & Net Drop Detection)

MATSYA-Node: Resolving the 3 Critical Field Questions (Weight, Camera Placement & Net Drop Detection)

Comments
5 min read
MATSYA-Node: Complete System Architecture, Hardware Selection & Working Mechanism

MATSYA-Node: Complete System Architecture, Hardware Selection & Working Mechanism

Comments
8 min read
MATSYA-Node: Our 4-Tier Core System Architecture to Win MATSYA 2026

MATSYA-Node: Our 4-Tier Core System Architecture to Win MATSYA 2026

Comments
5 min read
Stopping KV Secrets Leaks in Edge AI with Cloudflare Workers

Stopping KV Secrets Leaks in Edge AI with Cloudflare Workers

Comments
4 min read
The Rise of Small Language Models: Why Smaller is Better for the Future of AI

The Rise of Small Language Models: Why Smaller is Better for the Future of AI

Comments
3 min read
Liquid Neural Networks: The AI That Adapts on the Fly

Liquid Neural Networks: The AI That Adapts on the Fly

Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.