DevOps

How Amazon MSK Helped Us Stop Babysitting Kafka

Introduction For years, we have used Kafka in the Data Centre, then we moved to AWS and started using EC2 to run Kafka. However, the headaches increased along with our usage. We began to feel as though we were spending more time managing Kafka than creating anything of value due to broker upgrades, Zookeeper problems, imbalanced...

by Karandeep Singh
Tag: AmazonMSK
08-Jul-2025

DevOps

Safely Remove Kafka Brokers from Amazon MSK Provisioned Clusters

Introduction As companies grow and their data streaming needs change, it's important to optimize resources to stay efficient and control costs. AWS has rolled out a new feature for Amazon Managed Streaming for Apache Kafka (Amazon MSK) that enables the removal of brokers from MSK clusters. This capability enables you to adjust the size...

by Karandeep Singh
Tag: AmazonMSK
24-Sep-2024