Skip to content

Exploring AWS Copilot CLI for creating Python ETL jobs

License

Notifications You must be signed in to change notification settings

levon003/aws-etl-job

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AWS Fargate ETL job

Demonstrating the use of AWS Copilot CLI for creating ETL jobs on AWS Fargate.

See: https://containersonaws.com/pattern/scheduled-cron-job-container-ecs-copilot

I created a new configuration:

copilot init

If I want to re-deploy (because I've made changes to the Dockerfile, manifests, or code):

copilot deploy

If I want to invoke the job manually, rather than relying on the schedule:

copilot job run 

To view the most recent logs:

copilot job logs

For example:

% copilot job logs --env aws-etl-job --name aws-etl-job
copilot/aws-etl-job/6f8d4 Hello world!

About

Exploring AWS Copilot CLI for creating Python ETL jobs

Topics

Resources

License

Stars

Watchers

Forks