Deploy Conduktor & a MSK Cluster in 3 commands

#aws #kafka #conduktor #tutorial

Full blog post available at the Compose-X Labs

Use ECS Compose-X and the new x-msk_cluster extension to create new cluster/use existing ones, and connect your ECS services to it.

Run the demo in 3 commands

Install compose-x & the MSK extension

python3 -m pip install --user ecs-composex-msk-cluster

Download the compose file for the demo

wget https://raw.githubusercontent.com/compose-x/ecs_composex-msk_cluster/main/use-cases/conduktor.yaml

Deploy to AWS with ecs-compose-x

ecs-compose-x init && \
ecs-compose-x up -d templates -p msk-conduktor -f conduktor.yaml

This blog post uses Conduktor Platform as the example service given it has native IAM integration to AWS MSK and allows for testing connectivity & access to the Kafka Cluster.

You can log into the Conduktor platform using the defined username and passwords (defined in conduktor.yaml) and connect to http://<ecs_task_public_ip>:8080/