LakeHouse on Docker Compose

About

An local setup for Airflow v2 with docker-compose (future Lakehouse)

Prerequisites

Docker (started) and docker-compose (just install Docker for Desktop if you are on laptop)

Quickstart

Clone repo git clone https://github.com/datafuel/lakehouse_docker.git
Run cd lakehouse_docker
Rename .env.example to .env and replace dummy values with yours
Run docker-compose up then access the services

Integration with other stacks of datafuel

Run docker network create datafuel-local-network
Run docker-compose -f datafuel.docker-compose.yml

Make sure to wait at least 30 seconds before launching any service !