DEV Community

Ayush kumar profile picture

Ayush kumar

Lead Developer Advocate @NodeShift | Cloud, DevOps, Open Source & AI Enthusiast | Freelance Technical Writer & Content Creator | 80k+ Reads

Pronouns

He/Him

Work

Lead Developer Advocate @NodeShift

1 Week Community Wellness Streak
Four Year Club
Writing Debut
Three Year Club
Two Year Club
One Year Club
Hacktoberfest 2020
How to Install & Run Gemma-3-270m, GGUF & Instruct Locally?

How to Install & Run Gemma-3-270m, GGUF & Instruct Locally?

5
Comments
14 min read

Want to connect with Ayush kumar?

Create an account to connect with Ayush kumar. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
The OCR Model That Outranks GPT-4o

The OCR Model That Outranks GPT-4o

5
Comments 1
16 min read
The Open-Source App Builder That Ate SaaS: Dyad + Ollama Setup

The Open-Source App Builder That Ate SaaS: Dyad + Ollama Setup

5
Comments
12 min read
How to Install & Run GPT-OSS 20b and 120b GGUF Locally?

How to Install & Run GPT-OSS 20b and 120b GGUF Locally?

7
Comments
7 min read
The One-Click GPT-5 Code Machine: How I Built My Own AI Developer

The One-Click GPT-5 Code Machine: How I Built My Own AI Developer

6
Comments
10 min read
Zero to Docs Hero: Create a Python Documentation Generator with GPT-5

Zero to Docs Hero: Create a Python Documentation Generator with GPT-5

6
Comments
7 min read
How I Built a GPT-OSS 120B-Parameter Coding Beast That Reviews, Fixes, and Writes Code Like Magic

How I Built a GPT-OSS 120B-Parameter Coding Beast That Reviews, Fixes, and Writes Code Like Magic

7
Comments 1
9 min read
How to Install & Run OpenAI GPT-OSS Locally?

How to Install & Run OpenAI GPT-OSS Locally?

5
Comments
16 min read
GLM 4.5 vs. Promptfoo: A Playbook for Systematic LLM Security Audits

GLM 4.5 vs. Promptfoo: A Playbook for Systematic LLM Security Audits

5
Comments
19 min read
Promptfoo x Qwen3-Coder: Unmasking Vulnerabilities in 480 Billion Parameters

Promptfoo x Qwen3-Coder: Unmasking Vulnerabilities in 480 Billion Parameters

6
Comments
14 min read
The Untold Misadventures of Red Teaming Kimi K2 with Promptfoo

The Untold Misadventures of Red Teaming Kimi K2 with Promptfoo

5
Comments
14 min read
How I Built and Evaluated an AI Book-Writing System with ACP and Promptfoo

How I Built and Evaluated an AI Book-Writing System with ACP and Promptfoo

5
Comments
18 min read
How to Install Devstral Small 1.1 Locally?

How to Install Devstral Small 1.1 Locally?

5
Comments
11 min read
Building an AI-Powered Chest X-ray Analyzer with MedGemma 27B and Gradio

Building an AI-Powered Chest X-ray Analyzer with MedGemma 27B and Gradio

6
Comments
16 min read
Promptfoo x Ollama x DeepSeek R1: Turning My Model Into a Cyber Warzone

Promptfoo x Ollama x DeepSeek R1: Turning My Model Into a Cyber Warzone

7
Comments
11 min read
How to Install FLUX.1-Kontext-Dev Locally?

How to Install FLUX.1-Kontext-Dev Locally?

5
Comments
11 min read
Promptfoo vs Deepteam vs PyRIT vs Garak: The Ultimate Red Teaming Showdown for LLMs

Promptfoo vs Deepteam vs PyRIT vs Garak: The Ultimate Red Teaming Showdown for LLMs

5
Comments
10 min read
From OpenAI to Ollama: Visual LLM Evaluations with Promptfoo

From OpenAI to Ollama: Visual LLM Evaluations with Promptfoo

7
Comments
15 min read
LLMs Under Fire: Red Teaming with DeepTeam + Ollama

LLMs Under Fire: Red Teaming with DeepTeam + Ollama

9
Comments 2
10 min read
How to Install DeepSeek Nano-VLLM Locally?

How to Install DeepSeek Nano-VLLM Locally?

7
Comments
10 min read
How to Install Fanar-1 9B Arabic-English LLM Locally?

How to Install Fanar-1 9B Arabic-English LLM Locally?

5
Comments
7 min read
How to Install and Run Sarvam – M Locally?

How to Install and Run Sarvam – M Locally?

5
Comments 1
7 min read
Step-by-Step Guide to Run Llama 4 Locally with Tool Calling Enabled

Step-by-Step Guide to Run Llama 4 Locally with Tool Calling Enabled

8
Comments
7 min read
How to Install NVIDIA AceReason-Nemotron-14B Locally?

How to Install NVIDIA AceReason-Nemotron-14B Locally?

5
Comments 2
7 min read
Zed + Ollama + LLMs on a GPU VM: The Ultimate Local Dev Setup for Serious Coders

Zed + Ollama + LLMs on a GPU VM: The Ultimate Local Dev Setup for Serious Coders

13
Comments 2
10 min read
Void + Ollama + LLMs: How I Turned My Code Editor into a Full-Blown AI Workbench

Void + Ollama + LLMs: How I Turned My Code Editor into a Full-Blown AI Workbench

13
Comments
11 min read
Claude 4: Opus vs Sonnet, Benchmarks, and Dev Workflow with Claude Code

Claude 4: Opus vs Sonnet, Benchmarks, and Dev Workflow with Claude Code

9
Comments 1
8 min read
How to Install NanoVLM World`s Smallest Model Locally?

How to Install NanoVLM World`s Smallest Model Locally?

7
Comments 1
7 min read
How to Install SmolDocling-256M-Preview Locally?

How to Install SmolDocling-256M-Preview Locally?

7
Comments 1
7 min read
How to Install Qwen3-32B-GGUF Locally?

How to Install Qwen3-32B-GGUF Locally?

6
Comments
5 min read
How to Install Meta Perception LM 8B Locally?

How to Install Meta Perception LM 8B Locally?

5
Comments
7 min read
How to Install NVIDIA Parakeet TDT 0.6B V2 Locally?

How to Install NVIDIA Parakeet TDT 0.6B V2 Locally?

22
Comments
8 min read
How to Install Falcon 3 Locally?

How to Install Falcon 3 Locally?

6
Comments
6 min read
How to Install Nari Dia 1.6 B Locally?

How to Install Nari Dia 1.6 B Locally?

22
Comments
7 min read
How to Install Microsoft Phi-4 Reasoning Locally?

How to Install Microsoft Phi-4 Reasoning Locally?

8
Comments
5 min read
How to Install Qwen 3 Locally?

How to Install Qwen 3 Locally?

14
Comments
6 min read
Mastering DeepSeek: Installing Tiny, Small, and VL2 Models with Inference and a Gradio Interface

Mastering DeepSeek: Installing Tiny, Small, and VL2 Models with Inference and a Gradio Interface

24
Comments
10 min read
How to Install DeepSeek Janus Pro 7B Locally?

How to Install DeepSeek Janus Pro 7B Locally?

414
Comments
6 min read
How to Install Google PaliGemma 2 Locally?

How to Install Google PaliGemma 2 Locally?

19
Comments
7 min read
How to Install Llama-3.3 70B Instruct Locally?

How to Install Llama-3.3 70B Instruct Locally?

73
Comments 3
8 min read
How to deploy QwQ 32B Preview in the Cloud?

How to deploy QwQ 32B Preview in the Cloud?

10
Comments
6 min read
Run LangTrace – Open Source Observability Tool for LLM Applications

Run LangTrace – Open Source Observability Tool for LLM Applications

12
Comments 2
10 min read
Ollama and Web-LLM: Building Your Own Local AI Search Assistant

Ollama and Web-LLM: Building Your Own Local AI Search Assistant

34
Comments
8 min read
How to deploy Qwen2.5-Coder-32B-Instruct in the Cloud?

How to deploy Qwen2.5-Coder-32B-Instruct in the Cloud?

15
Comments
6 min read
Running AI Models with Open WebUI

Running AI Models with Open WebUI

20
Comments 5
9 min read
How to Backup Virtual Machines to Object Storage with Borg, Borgmatic, Rclone, and Cron's Rsync

How to Backup Virtual Machines to Object Storage with Borg, Borgmatic, Rclone, and Cron's Rsync

9
Comments
9 min read
How to deploy SmolLM2 1.7B on a Virtual Machine in the Cloud with Ollama?

How to deploy SmolLM2 1.7B on a Virtual Machine in the Cloud with Ollama?

11
Comments
6 min read
Build an App with AI in Minutes using OpenHands AI Engineer - Install Locally

Build an App with AI in Minutes using OpenHands AI Engineer - Install Locally

11
Comments
7 min read
How to deploy InternVL2-2B in the Cloud?

How to deploy InternVL2-2B in the Cloud?

11
Comments
8 min read
How to Install Minikube on Ubuntu Virtual Machine?

How to Install Minikube on Ubuntu Virtual Machine?

12
Comments
7 min read
How to run for inference Llama-3_1-Nemotron-51B-Instruct?

How to run for inference Llama-3_1-Nemotron-51B-Instruct?

11
Comments
6 min read
How to deploy Granite Dense 2B and 8B on a Virtual Machine in the Cloud?

How to deploy Granite Dense 2B and 8B on a Virtual Machine in the Cloud?

10
Comments
6 min read
How to deploy Solar Pro 22B in the Cloud?

How to deploy Solar Pro 22B in the Cloud?

13
Comments
5 min read
How to deploy Granite MOE 1B and 3B in the Cloud?

How to deploy Granite MOE 1B and 3B in the Cloud?

11
Comments
6 min read
How to deploy Llama-3.1-Nemotron-70B-Instruct on a Virtual Machine in the Cloud?

How to deploy Llama-3.1-Nemotron-70B-Instruct on a Virtual Machine in the Cloud?

20
Comments
6 min read
How to deploy Pixtral-12b in the Cloud?

How to deploy Pixtral-12b in the Cloud?

12
Comments
7 min read
Running a Dedicated Ethereum RPC Node in a Virtual Machine

Running a Dedicated Ethereum RPC Node in a Virtual Machine

13
Comments 1
8 min read
How to Configure WireGuard VPN in the Cloud

How to Configure WireGuard VPN in the Cloud

18
Comments
7 min read
How to deploy Molmo 7B-D-0924 in the Cloud?

How to deploy Molmo 7B-D-0924 in the Cloud?

13
Comments
9 min read
How to Install and Run Auraflow Image Generator Locally

How to Install and Run Auraflow Image Generator Locally

12
Comments
8 min read
loading...