Lab: Stock Market Kafka Real Time
Problem Statement
In this lab, you will execute an End-To-End Data Engineering on Real-Time Stock Market Data using Kafka.
We are going to use different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL.
Architecture
Dataset Used
You can use any dataset, we are mainly interested in operation side of Data Engineering (building data pipeline)
Complete Video Tutorial
Video Link - https://www.youtube.com/embed/KerNf0NANMo
Dataset Used
You can use any dataset, we are mainly interested in operation side of Data Engineering (building data pipeline)