Introduction Apache Kafka is a distributed system consisting of servers and clients that communicate via a high-performance TCP network protocol. We have components generating events (Producers) and components that consume those events (Consumers). Consumers label themselves with a consumer group name so that each record published on a...
In today's fast-paced digital landscape, businesses thrive or falter based on their ability to harness and make sense of data in real time. Apache Kafka, an open-source distributed event streaming platform, has emerged as a pivotal tool for organizations aiming to excel in the world of data-driven decision-making.In this blog post, we'll...
Introduction In the dynamic realm of data integration, schema registries are crucial, ensuring data coherence, harmony, and structure. Amidst notable contenders, Confluent Schema Registry and AWS Glue Schema Registry shine as prime choices for efficient schema management. With businesses aiming to enhance operations within the extensive...
Apache Kafka is an open-source distributed event streaming platform. That uses Publish & subscribe mechanism to stream the records. Download & Installing the Apache Kafka: Prerequisite: You should have Java (JDK) installed on your Windows machine. Step -1: Download the binary version from the kafka official download page...
In one of the recent use case, we had to implement a complex event processing in real time mode. Storm is used as real time processing engine, but since It doesn't provide batching of events therefore we took upon Esper to do the required job. Esper can be thought as a complex event processing (CEP) component generally used for event...