Lab: S3 Postgres Scala
Objective
Build an ETL pipeline that will load the S3 data into Postgres
Postgres JAR Installation
Upload the Postgres JAR file in Databricks and Install it.
After installation, it will look like this:
Databricks Notebook Code
Run this code. You can find this code in s3-postgres-etl.scala file which can be uploaded in databricks.
Final Data Load
The final data load in Postgres:
