Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data downloads block access from GitHub Issues #143

Closed
dhimmel opened this issue Nov 13, 2024 · 3 comments
Closed

Data downloads block access from GitHub Issues #143

dhimmel opened this issue Nov 13, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@dhimmel
Copy link

dhimmel commented Nov 13, 2024

Downloading https://tiles.skimap.org/geojson/runs.geojson works fine for me locally (via a python requests.get query), but the same query fails on GitHub Actions with:

HTTPError: 403 Client Error: Forbidden for url: 
https://tiles.skimap.org/geojson/runs.geojson

I am looking to update my project on a scheduled basis, such that I would do weekly or monthly downloads of the OpenSkiMap data resources. These would be scheduled or adhoc, but not on a per-commit / CI basis.

I imagine there might be some IP filters to try to reduce excessive bandwidth consumption. Not sure if @russellporter you control them.

Wanted to get your initial feedback on whether restrictions could be lifted or any sort of authorization is possible?

@dhimmel
Copy link
Author

dhimmel commented Nov 13, 2024

runs.geojson is quite large at 911 MB, although XZ compression reduces this to 96 MB. #137 could reduce the file size even more. So possibly other approaches to reduce storage and bandwidth costs.

@russellporter
Copy link
Owner

Hi, thanks for reporting this, this usage sounds reasonable to me, the block was not intended.

I've made some updates to the traffic filtering and shifted the domain so the new endpoint is https://tiles.openskimap.org/geojson/runs.geojson

Can you check if the issue is resolved?

@russellporter russellporter added the bug Something isn't working label Nov 14, 2024
dhimmel added a commit to dhimmel/openskistats that referenced this issue Nov 14, 2024
@dhimmel
Copy link
Author

dhimmel commented Nov 14, 2024

Issue is resolved as per this run.

Thanks!

@dhimmel dhimmel closed this as completed Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants