Data Engineering Project with Hadoop HDFS and Kafka

End to End OTP Pipeline Project using Docker, Airflow, Kafka, KafkaUI, Cassandra, MongoDB, EmailOperator, SlackWebhookOperator and DiscordWebhookOperator

Step-by-step guide for tracking MongoDB data changes using Debezium, Kafka, and NestJS along with cache invalidation use cases.

Initial Template.

A progressive example project demonstrating the evolution from monolithic architecture to event-driven microservices using Apache Kafka.