Skip to content

Python tool to watch and sync a directory to S3

License

Notifications You must be signed in to change notification settings

Polymathian/sharpei

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Sharpei

Python watchdog to sync file changes to AWS S3

Requires Python 3.6+

Usage

Sharpei can be run from the CLI or Docker.

CLI

Install from PyPI

pip install sharpei

To run:

# Monitor the current directory and send all files
> sharpei . s3://bucket/key-prefix/

Use sharpei --help to discover additional options

Docker

You will need to mount a directory to the Docker image as /data.

> docker run --mount type=bind,source=YOUR_DIRECTORY,target=/data sharpei s3://bucket/key-prefix

For example, given a folder structure:

working-dir
│   README.md
|
└───target-folder
        file011.txt
        file012.txt

To monitor file changes in target-folder, run:

> docker run --mount type=bind,source="$(pwd)"/target-folder,target=/data polymathian/sharpei s3://my-bucket/my-prefix