DEV Community

#localllm

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How Much RAM Do You Need for Local LLMs on a Mac?
wango profile

How Much RAM Do You Need for Local LLMs on a Mac?

#llm #localllm #ai #apple
Comments
3 min read
Claude Code MCP setup and usage rules
devlog profile

Claude Code MCP setup and usage rules

#clitools #macos #localllm
Comments
3 min read
Clone your own voice with a 17-second recording
devlog profile

Clone your own voice with a 17-second recording

#contentops #localllm #macos
Comments
2 min read
Prompt engineering: How to fix instructions that AI ignores
devlog profile

Prompt engineering: How to fix instructions that AI ignores

#promptengineering #ai #localllm
Comments
3 min read
How I upgrade xiaoai speaker local llm: Sub-200ms AI
umair24171 profile

How I upgrade xiaoai speaker local llm: Sub-200ms AI

#aiagents #localllm #iot #node
Comments 1
10 min read
What Happens When You Ask an LLM a Question
vishnuhd profile

What Happens When You Ask an LLM a Question

#ai #localllm #llmbasics #gpu
Comments
8 min read
Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPU
vishnuhd profile

Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPU

#ai #localllm #vllm #kubernetes
Comments
13 min read
I Ran DeepSeek V4 Flash Across Two DGX Sparks Over Ethernet
kevintang profile

I Ran DeepSeek V4 Flash Across Two DGX Sparks Over Ethernet

#ai #hardware #localllm #networking
Comments
11 min read
VRAM and RAM for local LLMs — honest planning bands, not a GPU tier list
tech_gurunomics profile

VRAM and RAM for local LLMs — honest planning bands, not a GPU tier list

#localllm #llm #ollama #hardware
Comments
4 min read
Running Ollama on a 32 GB MacBook Air: A Practical First Setup
vishnuhd profile

Running Ollama on a 32 GB MacBook Air: A Practical First Setup

#ai #localllm #ollama #applesilicon
Comments
6 min read
Running llama.cpp on a 32 GB MacBook Air: A Direct Comparison with Ollama
vishnuhd profile

Running llama.cpp on a 32 GB MacBook Air: A Direct Comparison with Ollama

#ai #localllm #llamacpp #ollama
Comments 1
9 min read
Ollama vs LM Studio: Which Local LLM Tool Should You Use?
mrsaynothing profile

Ollama vs LM Studio: Which Local LLM Tool Should You Use?

#ai #ollama #lmstudio #localllm
Comments
4 min read
llama.cpp vs Ollama: Which Should You Run in 2026?
mrsaynothing profile

llama.cpp vs Ollama: Which Should You Run in 2026?

#ai #llamacpp #ollama #localllm
Comments
6 min read
Best Local LLM for Coding: 8GB to 24GB VRAM Picks
mrsaynothing profile

Best Local LLM for Coding: 8GB to 24GB VRAM Picks

#ai #localllm #coding #ollama
Comments
5 min read
Running a 35B MoE Model on an 8 GB Laptop GPU: Testing FreeToken
vishnuhd profile

Running a 35B MoE Model on an 8 GB Laptop GPU: Testing FreeToken

#ai #localllm #freetoken #gpu
Comments 3
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.