-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bulk: testing for failures #48356
Closed
Closed
Bulk: testing for failures #48356
Changes from all commits
Commits
Show all changes
24 commits
Select commit
Hold shift + click to select a range
5c18b75
rebuild bowtie
aliciaaevans 74941e0
exclude branches that start with bulk
aliciaaevans 5b27f64
macOS SDK attempt
daler eeed429
test
daler 5b8d7dc
test
daler 346753f
[ci run]
daler 6d0884b
test
daler 6f9d75f
[ci run]
daler d86a126
[ci run]
daler d16adf0
[ci run]
daler b2fdf0d
[ci run]
daler d8f7ab2
[ci run]
daler fcf7e58
[ci run]
daler b2ab90c
[ci run]
daler d46b110
[ci run]
daler b61d168
[ci run]
daler 85fe911
[ci run]
daler ffbfc97
[ci run]
daler dbdb03d
[ci run]
daler 478c68b
[ci run]
daler f704610
[ci run]
daler f3c8244
[ci run]
daler 9ec2776
[ci run]
daler 7fbfefe
[ci run]
daler File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -229,6 +229,7 @@ workflows: | |
ignore: | ||
- master | ||
- bulk | ||
- /bulk.*/ | ||
matrix: | ||
parameters: | ||
os: | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -2,87 +2,18 @@ name: Bulk branch | |
on: | ||
push: | ||
branches: | ||
- bulk | ||
- bulk-osx-failures | ||
jobs: | ||
build-linux: | ||
name: Bulk Linux Builds | ||
if: "contains(github.event.head_commit.message, '[ci run]')" | ||
runs-on: ubuntu-latest | ||
strategy: | ||
fail-fast: false | ||
max-parallel: 6 | ||
matrix: | ||
runner: [0, 1, 2, 3, 4, 5] | ||
steps: | ||
- uses: actions/checkout@v4 | ||
with: | ||
# checkout as BiocondaBot in order to have the permission to push fail logs | ||
token: ${{secrets.BIOCONDA_BOT_REPO_TOKEN}} | ||
|
||
- name: set git user | ||
run: | | ||
git config user.name BiocondaBot | ||
git config user.email [email protected] | ||
|
||
- name: set path | ||
run: echo "/opt/mambaforge/bin" >> $GITHUB_PATH | ||
|
||
- name: Fetch conda install script | ||
run: | | ||
wget https://raw.githubusercontent.com/bioconda/bioconda-common/bulk/{common,install-and-set-up-conda,configure-conda}.sh | ||
|
||
- name: Restore cache | ||
id: cache | ||
uses: actions/cache@v4 | ||
with: | ||
path: /opt/mambaforge | ||
key: ${{ runner.os }}--bulk--${{ hashFiles('install-and-set-up-conda.sh', 'common.sh', 'configure-conda.sh') }} | ||
|
||
- name: Set up bioconda-utils | ||
if: steps.cache.outputs.cache-hit != 'true' | ||
run: bash install-and-set-up-conda.sh | ||
|
||
# This script can be used to reconfigure conda to use the right channel setup. | ||
# This has to be done after the cache is restored, because | ||
# the channel setup is not cached as it resides in the home directory. | ||
# We could use a system-wide (and therefore cached) channel setup, | ||
# but mamba does not support that at the time of implementation | ||
# (it ignores settings made with --system). | ||
- name: Configure conda | ||
run: bash configure-conda.sh | ||
|
||
- name: Build and upload | ||
env: | ||
ANACONDA_TOKEN: ${{ secrets.ANACONDA_TOKEN }} | ||
INVOLUCRO_AUTH: ${{ secrets.INVOLUCRO_AUTH }} | ||
QUAY_OAUTH_TOKEN: ${{ secrets.QUAY_OAUTH_TOKEN }} | ||
# Mimic circleci | ||
OSTYPE: "linux-gnu" | ||
CI: "true" | ||
run: | | ||
set -e | ||
eval "$(conda shell.bash hook)" | ||
conda activate bioconda | ||
echo '============' | ||
conda info --all | ||
conda config --show-sources | ||
python -c 'import bioconda_utils.utils as u ; import pathlib as p ; print(*(f"{f}:\n{p.Path(f).read_text()}" for f in u.load_conda_build_config().exclusive_config_files), sep="\n")' | ||
echo '============' | ||
bioconda-utils build recipes config.yml \ | ||
--worker-offset ${{ matrix.runner }} --n-workers 6 \ | ||
--docker --mulled-test --anaconda-upload --mulled-upload-target biocontainers \ | ||
--lint --record-build-failures --skiplist-leafs | ||
conda clean -y --all | ||
|
||
build-osx: | ||
name: Bulk OSX Builds | ||
if: "contains(github.event.head_commit.message, '[ci run]')" | ||
runs-on: macos-13 | ||
strategy: | ||
fail-fast: false | ||
max-parallel: 4 | ||
max-parallel: 1 | ||
matrix: | ||
runner: [0, 1, 2, 3] | ||
runner: [0] #, 1, 2, 3] | ||
steps: | ||
- uses: actions/checkout@v4 | ||
with: | ||
|
@@ -99,7 +30,7 @@ jobs: | |
|
||
- name: Fetch conda install script | ||
run: | | ||
wget https://raw.githubusercontent.com/bioconda/bioconda-common/bulk/{common,install-and-set-up-conda,configure-conda}.sh | ||
wget https://raw.githubusercontent.com/bioconda/bioconda-common/bulk-osx-failures/{common,install-and-set-up-conda,configure-conda}.sh | ||
|
||
- name: Restore cache | ||
id: cache | ||
|
@@ -133,17 +64,15 @@ jobs: | |
set -e | ||
eval "$(conda shell.bash hook)" | ||
conda activate bioconda | ||
|
||
# The SDK isn't actually cached, so reinstall it | ||
source common.sh | ||
run_conda_forge_build_setup | ||
|
||
echo $MACOSX_DEPLOYMENT_TARGET | ||
echo $MACOSX_SDK_VERSION | ||
echo '============' | ||
conda info --all | ||
conda config --show-sources | ||
conda activate bioconda | ||
python -c 'import bioconda_utils.utils as u ; import pathlib as p ; print(*(f"{f}:\n{p.Path(f).read_text()}" for f in u.load_conda_build_config().exclusive_config_files), sep="\n")' | ||
echo '============' | ||
bioconda-utils build recipes config.yml \ | ||
--worker-offset ${{ matrix.runner }} --n-workers 4 \ | ||
--lint --anaconda-upload --record-build-failures --skiplist-leafs | ||
bioconda-utils build recipes config.yml --packages bowtie | ||
conda clean -y --all |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is kind of hacky, but I did it because master is hard-coded in this yml file as the root branch and so building this would try to build everything from bulk.
Azure has the option to exclude PRs with the target of bulk so I did that on the bulk branch itself before branching this..