Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: isolate test suite #99

Merged
merged 26 commits into from
Mar 1, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
699e98d
feat: tests for steps
cpaniaguam Jan 31, 2024
4134845
Add new files and directories to .gitignore
cpaniaguam Feb 1, 2024
a937cbc
feat: handle tar.gz via lfs
cpaniaguam Feb 1, 2024
f870e1b
feat: add test data files for steps 2-5
cpaniaguam Feb 1, 2024
b7db6e7
refactor: test_steps
cpaniaguam Feb 1, 2024
52046b9
fix: remove old script runs outside test suite
cpaniaguam Feb 1, 2024
4d2f223
fix: remove unnecessary steps from and rename to tests
cpaniaguam Feb 1, 2024
1a87f84
Merge branch '96-isolate-test-suite' of https://github.com/brown-ccv/…
cpaniaguam Feb 1, 2024
c97573d
added test dependecies
kmilo9999 Feb 13, 2024
3439ff0
merge with main
kmilo9999 Feb 16, 2024
0d1dbf2
renamed github workflow file
kmilo9999 Feb 16, 2024
2eb7063
restoring test.yml file
kmilo9999 Feb 16, 2024
980d30b
fixed test step 3
kmilo9999 Feb 17, 2024
830bbc7
test: tests for steps 5-7
cpaniaguam Feb 23, 2024
de32013
test: update CI workflow to use test suite
cpaniaguam Feb 23, 2024
4d1f98e
fix: add lfs
cpaniaguam Feb 23, 2024
6fe6b38
fix: delete entry point
cpaniaguam Feb 26, 2024
df023e6
fix: restore original smoke test workflow with verbose
cpaniaguam Feb 26, 2024
276b1b0
ci: workflow with test suite
cpaniaguam Feb 26, 2024
fe27354
refactor: create_script function to accept track_name parameter
cpaniaguam Feb 26, 2024
f2fe347
fix: restore .gitignore
cpaniaguam Feb 26, 2024
7a37d26
docs: add module level docstring and some comments
cpaniaguam Feb 26, 2024
4511492
Merge branch '96-isolate-test-suite' of https://github.com/brown-ccv/…
cpaniaguam Feb 26, 2024
b362171
Apply suggestions from code review
cpaniaguam Feb 28, 2024
c9a02df
Apply suggestions from code review
cpaniaguam Feb 29, 2024
b1da226
Apply suggestions from code review
cpaniaguam Feb 29, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
*.tar.gz filter=lfs diff=lfs merge=lfs -text
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes to this file are no longer related to the main change, so we could split these out. But I think they are fine.

Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: Test Steps
name: Smoke Tests
on:
pull_request: {}
push:
Expand Down Expand Up @@ -35,16 +35,16 @@ jobs:
icesat2waves correct-separate --help # prelim name

cpaniaguam marked this conversation as resolved.
Show resolved Hide resolved
- name: first step B01_SL_load_single_file
run: load-file --track-name 20190502052058_05180312_005_01 --batch-key SH_testSLsinglefile2 --output-dir ./work
run: load-file --track-name 20190502052058_05180312_005_01 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
- name: second step make_spectra
run: make-spectra --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work
run: make-spectra --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
- name: third step plot_spectra
run: plot-spectra --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work
- name: fouth step IOWAGA threads
run: make-iowaga-threads-prior --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work
run: plot-spectra --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
- name: fourth step IOWAGA threads
run: make-iowaga-threads-prior --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
- name: fifth step B04_angle
run: make-b04-angle --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work
run: make-b04-angle --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
- name: sixth step B04_define_angle
run: define-angle --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work
run: define-angle --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
- name: seventh step B06_correct_separate
run: correct-separate --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work
run: correct-separate --track-name SH_20190502_05180312 --batch-key SH_testSLsinglefile2 --output-dir ./work --verbose
30 changes: 30 additions & 0 deletions .github/workflows/test_test_suite.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
name: Test Steps
on:
pull_request: {}
push:
branches: [ main ]
jobs:
python_run_scripts:
strategy:
fail-fast: false
matrix:
version: ['3.11']
runs-on: ubuntu-22.04
steps:
- name: install mpi
run: sudo apt update && sudo apt-get install openmpi-bin openmpi-doc libopenmpi-dev
- uses: actions/checkout@v3
with:
lfs: true
- name: setup python
uses: actions/setup-python@v4
with:
python-version: ${{ matrix.version }} # install the python version needed
cache: "pip"
- name: install icesat2-tracks using pip
run: pip install .
- name: install pytest
run: pip install pytest pytest-xdist pytest-sugar pytest-durations
- name: Run tests
run: pytest --capture=sys --verbose --showlocals --tb=long --numprocesses=auto tests/test_steps.py

Loading
Loading