Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: add maximize-space plugin to actions #3945

Merged
merged 3 commits into from
Feb 7, 2024

Conversation

vindard
Copy link
Contributor

@vindard vindard commented Feb 6, 2024

Description

This is a temporary solution to unblock our stuck PRs because of failing Actions


Integration / Bats

We have an issue right now where our /nix/store files (~6GB) and buck-out build folder (~11GB) are taking up too much of the ~21GB available on the github runner image disk to successfully execute tests.

There is a ~74GB /mnt partition available though that it seems is meant as a temp disk that just has a swap file and is otherwise unused.

Filesystem      Size  Used Avail Use% Mounted on
/dev/root        73G   53G   21G  73% /
tmpfs           7.9G  172K  7.9G   1% /dev/shm
tmpfs           3.2G  1.1M  3.2G   1% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/sdb15      105M  6.1M   99M   6% /boot/efi
/dev/sda1        74G  4.1G   66G   6% /mnt
tmpfs           1.6G   12K  1.6G   1% /run/user/1001

This plugin concatenates the free space on / and /mnt to a single LVM volume group and then mounts the build volume back to this new larger space.

Filesystem                   Size  Used Avail Use% Mounted on
/dev/root                     73G   61G   12G  84% /
tmpfs                        7.9G  172K  7.9G   1% /dev/shm
tmpfs                        3.2G  1.1M  3.2G   1% /run
tmpfs                        5.0M     0  5.0M   0% /run/lock
/dev/sda15                   105M  6.1M   99M   6% /boot/efi
/dev/sdb1                     74G   58G   12G  83% /mnt
tmpfs                        1.6G   12K  1.6G   1% /run/user/1001

/dev/mapper/buildvg-buildlv   61G   24K   61G   1% /home/runner/work/galoy/galoy

Note: This is a hacky solution since the /mnt folder isn't documented and may be changed or removed later on. It's a signal that we maybe need to either move to a larger paid action runner or switch to our own runner.

quickstart

The nix builds on root folder are pretty much at the ~21GB disk-availale limit right now. They can't be fixed in a straightforward way with the following plugin since the plugin targets re-mapping the workspace volume and not the entire root folder.

@github-actions github-actions bot added the ci label Feb 6, 2024
@vindard vindard force-pushed the consolidate-gh-runner-disk-space branch 3 times, most recently from aef0b0b to 289558b Compare February 7, 2024 02:31
@vindard vindard force-pushed the consolidate-gh-runner-disk-space branch from 289558b to 8dabfa8 Compare February 7, 2024 02:39
@vindard vindard merged commit 3a3c9d3 into main Feb 7, 2024
12 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants