DEV Community

Cover image for Demystifying Log Collection in Cloud-Native Applications on Kubernetes
Cloud Native Engineer
Cloud Native Engineer

Posted on

Demystifying Log Collection in Cloud-Native Applications on Kubernetes

🚢 My latest newsletter episode "Demystifying Log Collection in Cloud-Native Applications on Kubernetes"

Episode #36: A DevOps Engineer’s Guide to Aggregating Distributed Logs with Kubernetes and Elastic Tools.

  • 🖥️ DevOps Engineer Perspective: Exploring log collection from a DevOps viewpoint, aggregating logs from distributed sources into a single log analysis tool, like Elasticsearch

  • 🌐 Common challenges on Distributed Log Collection: log rotation, retry logic, in-memory buffers, async logging, and more.

  • 🛠️ Kubernetes Logging Mechanisms: how Kubernetes gathers and makes container logs available to log collection agents.

  • 🕸️ Nginx's logs in Kubernetes: how the modify Nginx container image to work in Kubernetes

  • 🔧 Node logging agent architecture: offload log collection to an external agent

  • 🪵Some common logging agents: Elastic agent, Elastic Beats, Otel collector

👉 Read the full article https://open.substack.com/pub/cloudnativeengineer/p/log-collection-in-kubernetes

Top comments (0)