Skip to content

Commit

Permalink
Add s3 upload
Browse files Browse the repository at this point in the history
  • Loading branch information
Javex committed Sep 26, 2023
1 parent ccc647d commit f641077
Showing 1 changed file with 11 additions and 1 deletion.
12 changes: 11 additions & 1 deletion .github/workflows/scrape-woolies.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,12 @@ on:
push:
schedule:
- cron: "0 1 * * *" # Daily at 1am UTC (12pm AEST)
env:
AWS_REGION: ap-southeast-2
jobs:
scrape-woolies:
permissions:
id-token: write # This is required for requesting the JWT
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
Expand All @@ -13,4 +17,10 @@ jobs:
- uses: actions/upload-artifact@v3
with:
name: woolies_all
path: ./woolies_all.json
path: ./woolies_all.json
- name: Configure AWS Credentials
uses: aws-actions/configure-aws-credentials@v4
with:
role-to-assume: "${TARGET_ROLE_ARN}"
aws-region: ap-southeast-2
- run: aws s3 cp ./woolies_all.json s3://grocery-scrape-au/woolies_all.json

0 comments on commit f641077

Please sign in to comment.