Introduction For years, we have used Kafka in the Data Centre, then we moved to AWS and started using EC2 to run Kafka. However, the headaches increased along with our usage. We began to feel as though we were spending more time managing Kafka than creating anything of value due to broker upgrades, Zookeeper problems, imbalanced...
Introduction AWS Elastic MapReduce (EMR) is an AWS service for filtering big data using open-source tools such as Apache Spark, Apache Flink, Trino, Hadoop, Hive, Presto, and many more. It provides a platform to run your applications without thinking much about the management of the underlying infrastructure. AWS EMR is a...
Introduction For over a decade, we've relied on AWS Managed Kubernetes (EKS) clusters to deploy our microservices workloads. As businesses increasingly depend on cloud-native applications, security, and compliance have become critical components for ensuring business continuity and growth. These applications, deployed across clusters,...