Skip to main content

Lab: Stock Market Kafka Real Time

Problem Statement

In this lab, you will execute an End-To-End Data Engineering on Real-Time Stock Market Data using Kafka.

We are going to use different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL.

Architecture

Dataset Used

You can use any dataset, we are mainly interested in operation side of Data Engineering (building data pipeline)

Complete Video Tutorial

Video Link - https://www.youtube.com/embed/KerNf0NANMo

Dataset Used

You can use any dataset, we are mainly interested in operation side of Data Engineering (building data pipeline)

Notebooks

nbviewer