Skip to content

duyydang/realtime_data_streaming

Repository files navigation

Real-time data streaming

This project use Kafka and Airflow to streaming data to Cassandra. Use Zookeeper to manager broker of Kafka and Airflow to manage data pipeline. Containerized with Docker for seamless deployment and scalability

System Architecture

alt text

About

End-to-end data pipeline orchestrating ingestion, processing, and storage. Utilizes Apache Airflow, Python, Kafka, Zookeeper, Spark, and Cassandra. Containerized with Docker for seamless deployment and scalability.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages