Java

Consumer Rebalancing in Kafka- An Overview

Introduction Apache Kafka is a distributed system consisting of servers and clients that communicate via a high-performance TCP network protocol. We have components generating events (Producers) and components that consume those events (Consumers). Consumers label themselves with a consumer group name so that each record published on a...

by honey.arora
Tag: Kafka
09-Nov-2023

AWS, Big Data

Unlocking the Potential: Kafka Streaming Integration with Apache Spark

In today's fast-paced digital landscape, businesses thrive or falter based on their ability to harness and make sense of data in real time. Apache Kafka, an open-source distributed event streaming platform, has emerged as a pivotal tool for organizations aiming to excel in the world of data-driven decision-making.In this blog post, we'll...

by ashish.gupta
Tag: Kafka
12-Oct-2023

AWS, Big Data

Mastering Schema Management: Transitioning from Confluent to AWS Glue Schema Registry

Introduction In the dynamic realm of data integration, schema registries are crucial, ensuring data coherence, harmony, and structure. Amidst notable contenders, Confluent Schema Registry and AWS Glue Schema Registry shine as prime choices for efficient schema management. With businesses aiming to enhance operations within the extensive...

by sukhpreet.singh
Tag: Kafka
25-Aug-2023

Drupal

How to install Apache Kafka | Kafdrop on WindowsFor and integrate with Drupal

Apache Kafka is an open-source distributed event streaming platform. That uses Publish & subscribe mechanism to stream the records.​ Download & Installing the Apache Kafka: ​Prerequisite: You should have Java (JDK) installed on your Windows machine. Step -1: Download the binary version from the kafka official download page...

by dharmendra.singh
Tag: Kafka
25-Jun-2023

Big Data

Realtime Event processing with Esper

In one of the recent use case, we had to implement a complex event processing in real time mode. Storm is used as real time processing engine, but since It doesn't provide batching of events therefore we took upon Esper to do the required job. Esper can be thought as a complex event processing (CEP) component generally used for event...

by Mohit Garg
Tag: Kafka
21-Jan-2015