Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indirect File Uploads #487

Open
browjm4 opened this issue Oct 17, 2024 · 0 comments
Open

Indirect File Uploads #487

browjm4 opened this issue Oct 17, 2024 · 0 comments

Comments

@browjm4
Copy link
Collaborator

browjm4 commented Oct 17, 2024

Reason

Certain customers are interested in using existing file storage as their object storage layer for DeepLynx

Design

  1. Upload file metadata to DeepLynx (eg file path, file name, file size, etc) without actually attaching a file to the POST request. The file should live somewhere other than the default file storage directory. If upload "works", see if DL has the permissions to access the file (by attempting to download). This should be tested on both azure and filesystem.
  2. If step 1 didn't work, modify the upload file pipeline (and perhaps download) to not be heavily constrained to the /containers/x/datasources/x filepath (but only if an alternative file path is provided)
  3. You could probably make a PR at that point

Impact

changes to the behavior supported in the upload file API endpoint (POST /containers/:containerID/import/datasources/:sourceID/files). Add documentation on this process from the user perspective (eg what the json body should look like for the request to get it to work).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant