Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cache package pages #91

Merged
merged 2 commits into from
Nov 13, 2024
Merged

Cache package pages #91

merged 2 commits into from
Nov 13, 2024

Conversation

alexheretic
Copy link
Contributor

@alexheretic alexheretic commented Nov 12, 2024

Add package page caching. Caches projects/_/packages non-last pages if all items are older than cache-releases-older-than conf.

With our usage we now have 1000-2000 releases and fetching pages takes around 6s. Caching the older pages allows this to come down to under 1s.

Before

INFO data:build_packfile: gitlab_cargo_shim: Fetched crate releases in 6.8s

After

INFO data:build_packfile: gitlab_cargo_shim: Fetched crate releases in 624.4ms

Caches `projects/_/packages` non-last pages if all items are older than `cache-releases-older-than` conf
@alexheretic alexheretic marked this pull request as ready for review November 13, 2024 17:19
@w4
Copy link
Owner

w4 commented Nov 13, 2024

Thanks!

@w4 w4 merged commit 044a8e0 into w4:main Nov 13, 2024
7 checks passed
@alexheretic alexheretic deleted the cache-package-pages branch November 13, 2024 17:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants