Create dag airflow to run this every 30 mins

[peterdudfield]

No description provided.

[alirashidAR]

@peterdudfield I would love to work on this , have some experience with airflow but would need some guidance on this to ensure everything aligns with the project's requirements .

[peterdudfield]

Yea, the way we run is its

1. Create a ECS task definition on AWS. This would be done a bit like this
2. Add a dag, that triggers this service to run, a bit like this

Your welcome to give it a go, but it definately much harder to test, due to AWS, terraform and airflow all interacting

[alirashidAR]

I'll start working on this as soon as openclimatefix/neso-solar-consumer#24 is merged. In the meantime, I'll work on gaining a better understanding of the testing requirements for this setup.