Pavan Madduri

CNCF TAG Workloads Foundation Tech Lead | Cloud-native and AI infrastructure engineer focused on AWS,AKS,OCI, Kubernetes, KEDA, GPU autoscaling, and platform engineering | Creator of keda-gpu-scaler

Chicago, IL Joined on Mar 11, 2025 https://pavanmadduri.wordpress.com/

Education

University of New Orleans

Work

Senior Cloud Platform Engineer at W.W.Grainger, Inc.

Pavan Madduri

Jul 8

The Self-Aware GPU Fleet: Closed-Loop Autoscaling with KEDA, MCP, and OKE

#oracle #kubernetes #ai #gpu

6 min read

Pavan Madduri

Jul 7

MCP Meets OCI: Teaching AI Agents to See Your GPUs on OKE

#oracle #kubernetes #ai #gpu

6 min read

Pavan Madduri

Jul 2

Serving 3 LLMs on 1 GPU - Multi-Model Inference with Docker on OKE

#ai #docker #kubernetes #oci

4 min read

Pavan Madduri

Jul 2

Monitoring GPU Inference Containers on OKE with OpenTelemetry - What Prometheus Misses

#oci #kubernetes #gpu #observability

4 min read

Pavan Madduri

Jul 1

Docker Build Cloud Cut My CI Build Times by 75%, Here's How I Wired It to OCIR

#docker #ci #oci #devops

4 min read

Pavan Madduri

Jun 30

How I Run GPU Workloads for 70% Less on OKE Using Preemptible Instances

#oci #kubernetes #gpu #infrastructure

4 min read

Pavan Madduri

Jun 29

Running Ollama on OCI Container Instances - Private LLM API in 5 Minutes, No Kubernetes

#ai #docker #oci #llm

4 min read

Pavan Madduri

Jun 26

Zero-Downtime Crossplane v1 v2 Migration: Adopt-in-Place at Production Scale

#crossplane #kubernetes #aws #platformengineering

8 min read

Pavan Madduri

Jun 24

Give Your AI Agent Eyes on GPUs: Introducing gpu-mcp-server

#agents #ai #mcp #monitoring

3 min read

Pavan Madduri

Jun 24

docker init OCIR OKE: From Empty Folder to Production in 15 Minutes

#docker #oci #devops #platformengineering

4 min read

Pavan Madduri

Jun 17

I Stopped Paying for Idle GPUs - Scale-to-Zero AI Inference on OKE with KEDA

#ai #keda #kubernetes #oci

4 min read

Pavan Madduri

Jun 16

Deploying vLLM on OKE with NVIDIA A10 GPUs: The 20-Minute Setup Nobody Talks About

#oci #docker #kubernetes #ai

5 min read

Pavan Madduri

Jun 12

Stop Downloading 8GB Models on Every Pod Restart - Use OCI Object Storage as a Model Cache

#docker #ai #kubernetes #oci

4 min read

Pavan Madduri

Jun 2

Docker vs Podman for AI/ML Workloads in 2026: A Technical Comparison

#docker #gpu #agents #ai

6 min read

Pavan Madduri

May 13

Docker Model Runner Replaced My Entire Local AI Setup

#docker #ai #llm #devtools

4 min read

Pavan Madduri

May 12

Every GPU Container Bug I've Hit on OKE (and How I Fixed Them)

#docker #gpu #kubernetes #oci

5 min read

Pavan Madduri

May 11

From Docker Compose on My Laptop to OKE in Production — Same App, Zero Rewrites

#docker #oci #kubernetes #devops

3 min read

Pavan Madduri

May 8

I Cut My Container Image Costs 60% by Building Multi-Arch Docker Images on OCI ARM

#oke #docker #oci #containers

5 min read

Pavan Madduri

May 8

The Zero-Trust Docker Pipeline: Securing GPU/AI Container Images from Build to Production

#ai #docker #gpu #security

6 min read

Pavan Madduri

May 8

GPU-Aware Autoscaling for Docker Containers: From NVML to Production

#gpu #nvml #nvidia #docker

5 min read

Pavan Madduri

May 8

I Replaced a $3/hr GPU Dev Workflow with Docker Model Runner. Here's How

#ai #gpu #docker #dockermodelrunner

8 min read

Pavan Madduri

May 8

Docker + OKE: Running GPU Inference Containers on Oracle Cloud

#oke #gpu #oci #docker

7 min read

Pavan Madduri

May 8

Securing Docker Images on OCI — OCIR, Docker Scout, and OCI Vault

#oci #oke #dockerscout #ocivault

6 min read

Pavan Madduri

May 8

Running Docker Containers on OCI Without Kubernetes

#oracle #docker #oke #containers

6 min read

Pavan Madduri

Mar 11

Deploying a Production-Ready K3s Cluster on OCI Always Free ARM Instances

#oracle #k3s #kubernetes #cloudnative

11 min read

Pavan Madduri

Mar 7

Why Your Kubernetes Cluster Breaks 18 Minutes After a Successful Deployment

#kubernetes #gitops #argocd #devops

2 min read

Pavan Madduri

Mar 2

Alert Fatigue is Breaking DevOps: Here is the Math

#devops #sre #mentalhealth #observability

2 min read

Pavan Madduri

Mar 2

What is an AI Agent? (And Why SREs Need Them)

#ai #sre #devops #aiops

2 min read

DEV Community

Pavan Madduri

Badges

One Year Club

Available for

The Self-Aware GPU Fleet: Closed-Loop Autoscaling with KEDA, MCP, and OKE

MCP Meets OCI: Teaching AI Agents to See Your GPUs on OKE

Serving 3 LLMs on 1 GPU - Multi-Model Inference with Docker on OKE

Monitoring GPU Inference Containers on OKE with OpenTelemetry - What Prometheus Misses

Docker Build Cloud Cut My CI Build Times by 75%, Here's How I Wired It to OCIR

How I Run GPU Workloads for 70% Less on OKE Using Preemptible Instances

Running Ollama on OCI Container Instances - Private LLM API in 5 Minutes, No Kubernetes

Zero-Downtime Crossplane v1 v2 Migration: Adopt-in-Place at Production Scale

Give Your AI Agent Eyes on GPUs: Introducing gpu-mcp-server

docker init OCIR OKE: From Empty Folder to Production in 15 Minutes

I Stopped Paying for Idle GPUs - Scale-to-Zero AI Inference on OKE with KEDA

Deploying vLLM on OKE with NVIDIA A10 GPUs: The 20-Minute Setup Nobody Talks About

Stop Downloading 8GB Models on Every Pod Restart - Use OCI Object Storage as a Model Cache

Docker vs Podman for AI/ML Workloads in 2026: A Technical Comparison

Docker Model Runner Replaced My Entire Local AI Setup

Every GPU Container Bug I've Hit on OKE (and How I Fixed Them)

From Docker Compose on My Laptop to OKE in Production — Same App, Zero Rewrites

I Cut My Container Image Costs 60% by Building Multi-Arch Docker Images on OCI ARM

The Zero-Trust Docker Pipeline: Securing GPU/AI Container Images from Build to Production

GPU-Aware Autoscaling for Docker Containers: From NVML to Production

I Replaced a $3/hr GPU Dev Workflow with Docker Model Runner. Here's How

Docker + OKE: Running GPU Inference Containers on Oracle Cloud

Securing Docker Images on OCI — OCIR, Docker Scout, and OCI Vault

Running Docker Containers on OCI Without Kubernetes

Deploying a Production-Ready K3s Cluster on OCI Always Free ARM Instances

Why Your Kubernetes Cluster Breaks 18 Minutes After a Successful Deployment

Alert Fatigue is Breaking DevOps: Here is the Math

What is an AI Agent? (And Why SREs Need Them)