Skip to content

In this repository I create an Extract, Transform and Load data pipeline using Apache Airflow to extract data from Microsoft SQL server into PostgreSQL database. The main database used here is AdventureWorksDB2019 for SQLServer.

Notifications You must be signed in to change notification settings

louis103/ETL_Pipeline_using_Apache_Airflow

Repository files navigation

Extract Transform Load data Pipeline using Apache Airflow

A snapshot of adventureWorks2019 Database

adventureWorks2019

Creating a postgreSQL database named adventureWorks to store cleaned data

postgresCreate

Creating user and password for both SQL server and postgreSQL.

postgresCreate

postgresCreate

Sample data processing code

postgresCreate

SQL query on postgreSQL AdventureWorks database to fetch imported tables

postgresCreate

Apache Airflow DAG workflow process(product_etl_dag)

postgresCreate

About

In this repository I create an Extract, Transform and Load data pipeline using Apache Airflow to extract data from Microsoft SQL server into PostgreSQL database. The main database used here is AdventureWorksDB2019 for SQLServer.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages