Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support url to download zip from HTTP(s) server using Range header #91

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

agix
Copy link

@agix agix commented Mar 18, 2022

Zip format doesn't allow real unzipping from a stream as it starts from the end and you can't really know the end of a stream.

Nevertheless, it doesn't mean you absolutely need the entire zip on your disk.

As long as you know the size of the zip file, and you are able to read part of it based on offset, it can be unzipped without touching the disk.

This PR aim to provide this feature from HTTP(S) server supporting Range header:

https://developer.mozilla.org/en-US/docs/Web/HTTP/Range_requests

The server should also respond the size of the file via HEAD request in Content-length response header (which is pretty standard).

@tsibley
Copy link

tsibley commented Jan 6, 2023

I'd like to see this feature!

* fix: Deduplicate entries

* fix: Deduplicate entries first
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants