lazydata.yml spec, v1

Specification for the lazydata.yml file version 1.

Version declaration

Needs to be:

version: 1

Remote backend

Example

remote: s3://mybucket/lazydata

remote: Specifies the location of the remote backend. Currently supported are S3 buckets and location within that backend which is the root for lazydata.

Files

Example

files:
  - path: data/my_big_table.csv
    hash: 2C94697198875B6E...
    usage: 
       - my_script.py
       - my_script2.py

files: A list of files tracked by lazydata.

path: A local path, relative to the lazydata.yml base directory

hash: SHA256 hash of the file.

usage: A list of files where the lazydata.use() function has been used. As a special case, a single value e.g. usage: myscript.py is also accepted.