Skip to content

DEV Community

# gpu

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Mar 29

Nvidia GreenBoost Lets You Fake More VRAM — And It Actually Kind of Works

#nvidia #opensource #ai #gpu

4 min read

soy

Mar 28

Boost Local LLMs: TurboQuant KV Cache, Fast Cold Starts, & Rust GPU Dev

#gpu #ai #performance

4 min read

Mar 28

Fix Zombie VRAM: Clear GPU Memory Without Rebooting

#linux #gpu #docker #devops

4 min read

Mar 27

I shipped Google's TurboQuant as a vLLM plugin 72 hours after the paper — here's what nobody else tested

#ai #python #machinelearning #gpu

3 min read

Kunal

Mar 27

Local LLM vs Claude for Coding: I Benchmarked a $500 GPU Against Cloud AI [2026]

#localllm #gpu #benchmarking #claude

8 min read

soy

Mar 27

Local LLM Power-Ups: Voxtral TTS, TurboQuant, & Sub-Second Cold Starts

#gpu #ai #performance

3 min read

Mar 28

Compressed VLM inference from a single Containerfile — turboquant-vllm v1.1

#python #vllm #gpu #containers

2 min read

soy

Mar 26

vLLM On-Demand Gateway: Zero-VRAM Standby for Local LLMs on Consumer GPUs

#vllm #llm #gpu #python

4 min read

soy

Mar 26

Local LLM Unleashed: Faster Inference, Instant Starts, & Open TTS

#gpu #ai #performance

4 min read

plasmon

Mar 25

I Tried Speculative Decoding on RTX 4060 8GB — Every Config Was Slower Than Baseline

#llm #gpu #benchmark #ai

8 min read

soy

Mar 24

Local LLM Security Criticals, Rust on GPU, & Deep Dive into PTX Optimization

#gpu #ai #performance

3 min read

Mar 24

Building a Cost-Effective Local AI Server in 2026: Proxmox, PCIe Passthrough, and Surviving the GPU Shortage

#ai #devops #gpu #tutorial

4 min read

vCluster

Mar 23

Introducing vMetal: Run Your GPU Data Center Like a Hyperscaler

#vcluster #vmetal #gpu #kubernetes

4 min read

Mar 21

I Rented Out My GPU for Passive Income — Here’s What Happened After My First Week

#gpu #passiveincome #ai #selfhosted

4 min read

ppcvote

Mar 20

Running a 4-Agent AI Fleet on a Single NVIDIA RTX 3060 Ti

#nvidia #gpu #rtx3060ti #ollama

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.