Inference

👋 Sign in for the ability to sort posts by relevant, latest, or top.

David Aronchick

May 5

The Inference Inversion

#distributedcomputing #edgecomputing #nvidia #inference

7 min read

Gabriel Anhaia

Apr 26

Muse Spark beats Llama 4 with 10x less compute. Here's how.

#ai #llm #architecture #inference

7 min read

Bruno Verachten

Apr 22

First Words: LLM Inference on RISC-V

#bananapi #benchmark #inference #llamacpp

9 min read

Berkan Sesen

Apr 13

Gaussian Process Regression: The Bayesian Approach to Curve Fitting

#bayesian #supervisedlearning #probabilistic #inference

13 min read

Alan West

Apr 7

Google Dropped TurboQuant Two Weeks Ago. The Community Already Made It Usable.

#turboquant #locallm #inference #opensource

6 min read

Berkan Sesen

Apr 26

Hierarchical Bayesian Regression with PyMC: When Groups Share Strength

#bayesian #probabilistic #inference #pymc

13 min read

Berkan Sesen

Mar 29

From MLE to Bayesian Inference: Why Your Estimate Needs a Prior

#bayesian #inference #statistics #probabilistic

15 min read

Berkan Sesen

Mar 27

The EM Algorithm: An Intuitive Guide with the Coin Toss Example

#unsupervisedlearning #inference #optimisation #probabilistic

10 min read

Berkan Sesen

Mar 26

Maximum Likelihood Estimation from Scratch: From Coin Flips to Gaussians

#statistics #inference #optimisation #probabilistic

13 min read

MrJHSN

Mar 19

DGX Spark Inference Performance: Local LLM vs Cloud Benchmarks (2026)

#dgx #llm #inference #benchmark

5 min read

Artyom Kornilov

Mar 10

Estimating Operational Costs for CLIP-Based Image Search on 1 Million Images: Infrastructure Expenses Focused

#clip #gpu #inference #cost

12 min read

deharoalexandre-cyber

Apr 8

I built an Ollama alternative with TurboQuant, model groups, and multi-GPU support

#ai #llm #cpp #inference

4 min read

Custodia-Admin

Mar 13

How to Optimize AI Agent Costs — Inference, API Calls, and Infrastructure

#agents #costs #optimization #inference

3 min read

Rotifer Protocol

Mar 31

Why Inference Compression Compounds for Modular Agents

#inference #compression #agents #gene

4 min read

Matt Frank

Feb 23

Model Serving Infrastructure: Building Scalable Inference

#modelserving #inference #mlops

7 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# inference

The Inference Inversion

Muse Spark beats Llama 4 with 10x less compute. Here's how.

First Words: LLM Inference on RISC-V

Gaussian Process Regression: The Bayesian Approach to Curve Fitting

Google Dropped TurboQuant Two Weeks Ago. The Community Already Made It Usable.

Hierarchical Bayesian Regression with PyMC: When Groups Share Strength

From MLE to Bayesian Inference: Why Your Estimate Needs a Prior

The EM Algorithm: An Intuitive Guide with the Coin Toss Example

Maximum Likelihood Estimation from Scratch: From Coin Flips to Gaussians

DGX Spark Inference Performance: Local LLM vs Cloud Benchmarks (2026)

Estimating Operational Costs for CLIP-Based Image Search on 1 Million Images: Infrastructure Expenses Focused

I built an Ollama alternative with TurboQuant, model groups, and multi-GPU support

How to Optimize AI Agent Costs — Inference, API Calls, and Infrastructure

Why Inference Compression Compounds for Modular Agents

Model Serving Infrastructure: Building Scalable Inference