Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Align result format to what is expected from website #269

Merged
merged 44 commits into from
Nov 22, 2023

Conversation

rcannood
Copy link
Member

Describe your changes

Issue ticket number and link

Closes #xxxx (Replace xxxx with the GitHub issue number)

Checklist before requesting a review

  • I have performed a self-review of my code

  • Check the correct box. Does this PR contain:

    • Breaking changes
    • New functionality
    • Major changes
    • Minor changes
    • Bug fixes
  • Proposed changes are described in the CHANGELOG.md

  • CI Tests succeed and look good!

@rcannood rcannood requested a review from KaiWaldrant October 19, 2023 20:52
KaiWaldrant
KaiWaldrant previously approved these changes Oct 20, 2023
@KaiWaldrant KaiWaldrant dismissed their stale review October 20, 2023 06:41

error in ci test due to changes in script

@KaiWaldrant KaiWaldrant self-requested a review October 20, 2023 06:41
@@ -22,7 +24,7 @@ def check_structure(slot_info, adata_slot):
return missing

print('Load data', flush=True)
adata = ad.read_h5ad(par['input']).copy()
adata = ad.read_h5ad(par['input'], backed='r')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Due to this change .X is not available anymore if it is empty/None and causes an error downstream on line 100:

scverse/anndata#715

@rcannood rcannood changed the title wip attempt at storing metadata as part of the pipeline Generate website result files Nov 21, 2023
@rcannood rcannood changed the title Generate website result files Align result format to what is expected from website Nov 22, 2023
@rcannood rcannood merged commit 7745486 into main Nov 22, 2023
12 checks passed
@rcannood rcannood deleted the save_all_metadata_in_wf branch November 22, 2023 14:44
rcannood added a commit that referenced this pull request Nov 24, 2023
* wip attempt at storing metadata as part of the pipeline

* extract scores as yaml

* fix metadata storage

* undo extract scores changes

* make sure check_dataset_schema also works with np.ndarray and pd.core.series.Series

* fix is_atomic

* simplify types

* require less resources

* remove unnecessary changes

* collect data in separate steps

* revert andata import

* add trace collectin for seqera platform

* refactor get_results

* update get_method info

* update metric

* refactor task_info

* WIP workflow transform inf yamls

* fix common workflow

* remove local trace

* update transform workflow cmd

* remove view

* WIP fix test

* update res test scripts

* fix test resource script

* fix common tests

* fix typo

* disable api_info comp

* add labelsto common configs

* add nf_tower test

* convert nan to none

* wip add normalize results

* add normalize function

* update workflow

* fix adding resources

* fix errors in get_results output

* add method info

* reformat nextflow wf

* ignore different normalization methods in the dataset meta

* add missing uns fields

* clean up script

* use solution to check dataset uns

* fix comment in script

* flatten method info results

---------

Co-authored-by: Kai Waldrant <[email protected]>
rcannood added a commit that referenced this pull request Nov 28, 2023
* WIP cellxgene component

* update to specific cellxgene version

* Add initial cellxgene comp

* small update

* add source download componnent

* update cellcensus query comp

* remove cellcensus_source, rename cellxgene to query_cellxgene_census

* use formatter

* update component

* add todo to test

* fix test

* remove filter function

* Ali (#269)

* wip attempt at storing metadata as part of the pipeline

* extract scores as yaml

* fix metadata storage

* undo extract scores changes

* make sure check_dataset_schema also works with np.ndarray and pd.core.series.Series

* fix is_atomic

* simplify types

* require less resources

* remove unnecessary changes

* collect data in separate steps

* revert andata import

* add trace collectin for seqera platform

* refactor get_results

* update get_method info

* update metric

* refactor task_info

* WIP workflow transform inf yamls

* fix common workflow

* remove local trace

* update transform workflow cmd

* remove view

* WIP fix test

* update res test scripts

* fix test resource script

* fix common tests

* fix typo

* disable api_info comp

* add labelsto common configs

* add nf_tower test

* convert nan to none

* wip add normalize results

* add normalize function

* update workflow

* fix adding resources

* fix errors in get_results output

* add method info

* reformat nextflow wf

* ignore different normalization methods in the dataset meta

* add missing uns fields

* clean up script

* use solution to check dataset uns

* fix comment in script

* flatten method info results

---------

Co-authored-by: Kai Waldrant <[email protected]>

* change namespace

* update component

---------

Co-authored-by: Robrecht Cannoodt <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants