Skip to content

Latest commit

 

History

History

aws-glue-iceberg

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
iceberg-books.ipynb
iceberg-books.ipynb
 
 
iceberg-lakefs-nyc.ipynb
iceberg-lakefs-nyc.ipynb
 
 

README.md

Integration of lakeFS with Glue Notebooks and Iceberg

Start by ⭐️ starring lakeFS open source project.

This repository includes following Glue notebooks:

  1. iceberg-books:
  • Use Case: Isolated Dev/Test Environments
  • This interactive notebook demonstrate integration of lakeFS with Glue Notebooks and Iceberg with a basic example.
  1. iceberg-lakefs-nyc:
  • Use Case: Isolated Dev/Test Environments
  • This interactive notebook demonstrate integration of lakeFS with Glue Notebooks and Iceberg for NYC Film Permits example.

Prerequisites

  • lakeFS installed and running in your AWS environment or in the lakeFS Cloud. If you don't have lakeFS already running then either use lakeFS Cloud which provides free lakeFS server on-demand with a single click or Deploy lakeFS on AWS doc.

Setup

Download these notebooks from GitHub and upload these notebooks as Jupyter notebooks in your AWS Glue Studio.

Demo Instructions

Open the notebook in Glue Studio and follow the instructions.