Local setup for Dremio on docker-compose
- Clone repo
git clone https://github.com/datafuel/dremio_docker.git
- Run
cd dremio_docker
- Rename .env.example to .env and replace dummy values with yours
- Run
docker-compose up
then access the services
Configuring S3 for Minio (source : Dremio Docs)
To configure your S3 source for Minio in the Dremio UI:
- Under Advanced Options, check Enable compatibility mode (experimental).
- Under Advanced Options > Connection Properties, add fs.s3a.path.style.access and set the value to true.
- Under Advanced Options > Connection Properties, add the fs.s3a.endpoint property and its corresponding server endpoint value (minio:9000 in the Datafuel ecosystem).