DEV Community

Sven Welack profile picture

Sven Welack

Derivatives Modelling and COO in Finance Industry

Location Singapore Joined Joined on  twitter website
LLMs on Consumer Hardware — Part 5: Distributing the Workers and the Memory Budget
sven_welack profile

LLMs on Consumer Hardware — Part 5: Distributing the Workers and the Memory Budget

#localllama #ai #llm #agents
Comments
4 min read

Want to connect with Sven Welack?

Create an account to connect with Sven Welack. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
LLMs on Consumer Hardware — Part 4: The Coordinator Search — Role-Casting and the Memory Wall
sven_welack profile

LLMs on Consumer Hardware — Part 4: The Coordinator Search — Role-Casting and the Memory Wall

#localllama #ai #llm #agents
Comments
4 min read
LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks
sven_welack profile

LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks

#localllama #ai #llm #homelab
Comments
3 min read
LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC
sven_welack profile

LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC

#localllama #ai #llm #homelab
Comments 3
4 min read
LLMs on Consumer Hardware — Part 3: A Multi-Agent Setup with Hermes — Delegation and Early Failure Modes
sven_welack profile

LLMs on Consumer Hardware — Part 3: A Multi-Agent Setup with Hermes — Delegation and Early Failure Modes

#localllama #ai #llm #agents
Comments
5 min read
loading...