Llamacpp

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Rickesh T N

Aug 24

My inference server decided my second GPU no longer exists. Here is how I got it back without upgrading a driver.

#gpu #llamacpp #ollama #homelab

3 min read

Umair Bilal

Aug 23

Fix Local LLM Quality: Context Stacking & Rope Freq Tweaks

#localllms #aiagents #ollama #llamacpp

8 min read

Jasur Yuldoshev

Aug 21

"V cache quantization requires flash_attn" — the llama.cpp error that quietly halves your context window

#llamacpp #llm #performance #debugging

10 min read

the kilted dev

Aug 11

Nine ways to talk to a local model

#localllm #ollama #llamacpp #buildinpublic

9 min read

Anish Shrestha

Aug 1

Running a 26B MoE on an 8 GB Jetson by streaming experts from SSD

#moestream #llamacpp #mixtureofexperts #jetsonorin

6 min read

Pneumetron

Jul 18

GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development

#gguf #llamacpp #quantized #minicpm5

3 min read

sampathmannam

Jul 14

Running a 1.5B-Parameter LLM Entirely On-Device for Mental Health — The NilaMind Architecture

#llamacpp #opensource #android

5 min read

Creeta

Jun 18

llama-bench skipped FA on capable GPUs — b9437 corrects it

#llamacpp #llm #gguf #flashattention

7 min read

Jasur Yuldoshev

Jul 18

Hot-swapping GGUF models kernel-panicked my M4 Mac: wired memory, llama.cpp, and why we restart the server instead

#llm #macos #debugging #llamacpp

5 min read

Kunal

Jun 5

Hermes Agent Desktop Free With Local LLMs: The Claude Code Alternative Nobody's Billing You For [2026]

#hermesagent #localllm #claudecodealternative #llamacpp

8 min read

Federico "SpeederX" Piana

Jul 4

What secretly eats your local LLMs' speed as your context fills up - Part 2

#ai #machinelearning #locallm #llamacpp

4 min read

ZyVOP

Jun 22

Can a $2,000 Mini PC Replace Your AI Cloud Bill?

#localai #strixhalo #hermesagent #llamacpp

9 min read

Patrick Hughes

Jun 9

How to Tune llama.cpp --n-gpu-layers: A Practical VRAM Guide (2026)

#localllm #llamacpp #gpu #vram

4 min read

Patrick Hughes

Jun 8

How to Tune --n-gpu-layers for Your VRAM Budget

#localllm #llamacpp #gpu #vram

4 min read

Patrick Hughes

Jun 4

llama.cpp ngl: when -ngl 99 still runs on your CPU

#llamacpp #localllm #gpuoffloading #ngpulayers

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.