DevOps

How Amazon MSK Helped Us Stop Babysitting Kafka

Introduction For years, we have used Kafka in the Data Centre, then we moved to AWS and started using EC2 to run Kafka. However, the headaches increased along with our usage. We began to feel as though we were spending more time managing Kafka than creating anything of value due to broker upgrades, Zookeeper problems, imbalanced...

by Karandeep Singh
Tag: kafkaonaws
08-Jul-2025

DevOps

How Rack Awareness in Amazon MSK Saved $36K/Year for a Leading AdTech Company

Introduction Building and deploying applications that use Apache Kafka for real-time data processing is made simple with Amazon MSK (Managed Streaming for Apache Kafka), a fully managed service by AWS. Rack awareness is one overlooked configuration change that can greatly increase fault tolerance and cost effectiveness, even though MSK...

by Karandeep Singh
Tag: kafkaonaws
04-Jun-2025