Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EFS on ec2 vs EFS for ECS tasks #13

Open
SorooshMani-NOAA opened this issue May 1, 2023 · 0 comments
Open

EFS on ec2 vs EFS for ECS tasks #13

SorooshMani-NOAA opened this issue May 1, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@SorooshMani-NOAA
Copy link
Collaborator

SorooshMani-NOAA commented May 1, 2023

The EFS mounted on ec2 is accessed separately from EFS accessed during ECS jobs. The EFS is mounted on the ec2 during the ansible playbook tasks. Then all the workflow (i.e. Prefect) tasks that run directly on the ec2 can access it, such as tasks initializing directory structure or copying tasks between EFS and s3 bucket, etc. However the EFS is accessed directly via a Volume mount in the ECS tasks.

This makes testing and mocking harder. For example if we run an agent locally, the directory is initialized on the local machine, but then in the ECS task, the docker process tries to create files/folders directly on the actual EFS.

@SorooshMani-NOAA SorooshMani-NOAA added the enhancement New feature or request label May 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant