Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamically create s3 bucket #355

Open
hoangna1204 opened this issue Oct 17, 2024 · 0 comments
Open

Dynamically create s3 bucket #355

hoangna1204 opened this issue Oct 17, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@hoangna1204
Copy link
Collaborator

Detailed description of the feature

Currently we need to specify S3_URL in the configurations in multiple services (api, conversion, mosaic, etc.). And on the
Frontend we allow users to create workspaces (which is equivalent to 1 bucket).

The problem is that since the S3 providers (Amazon, Digital Ocean, etc.) requires a bucket to be created first to be able to use it. That means the S3_URL must be dynamically created/configured during the workspace creation time instead of hard coding ones.

Even though we can find providers that offer providing 1 S3_URL and then creating buckets under the hood, I have not found out such providers.

Therefore, I suggest to change the S3_URL from statically defined to dynamic creation. Meaning that with the creation of the workspace, the bucket will also be created automatically. Afterwards, the S3_URL will be stored in the database together with the workspace information. Then when we select a workspace to work with, we use this S3_URL which we get from the database instead.

This will require some changes in the frontend as well. An additional dropdown box that allow users to select regions where the bucket will be created (and thus the S3_REGION static configuration will also be removed from the .env). For now we restrict only EU region and US region as we will target the markets in these regions.

Description of the use case

No response

Explanation of the benefits

No response

Possible Implementation (if applicable)

No response

Any additional information, context, or logs

No response

@hoangna1204 hoangna1204 added the enhancement New feature or request label Oct 17, 2024
@bouassaba bouassaba added this to the v3.0 milestone Oct 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants