Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce footprint of pipeline #184

Open
1 task
slsevilla opened this issue Feb 23, 2024 · 1 comment
Open
1 task

Reduce footprint of pipeline #184

slsevilla opened this issue Feb 23, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@slsevilla
Copy link
Contributor

slsevilla commented Feb 23, 2024

Improvement

After running 12 samples with three contrasts, 2700 jobs were created, not including DIFFBIND processes. We can reduce a lot of this with jaccard (#182) but that is still leaving about 824 jobs for a relatively small dataset. This doesn't include the parallel jobs being pushed by modules (#183) which probably inflates this value over 1K.

Opening this as a master issue so we can identify places to reduce the footprint.

@slsevilla slsevilla added the bug Something isn't working label Feb 23, 2024
@kelly-sovacool
Copy link
Member

related to #91

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants