Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

spades-hammer finishing with abnormally, OS return value: -7 but with an (possibly) error message saying 'None' after 'writing down entries' #1400

Open
1 task done
jfy133 opened this issue Oct 25, 2024 · 6 comments
Labels
io Input / output (e.g. due to disk storage) errors

Comments

@jfy133
Copy link

jfy133 commented Oct 25, 2024

Description of bug

For quite a while now I've been receiving errors of the following when running metaSPAdes.

== Error ==  system call for: "['/usr/local/bin/spades-hammer', '/fusion/s3/nf-core-awsmegatests/work/mag/work-409d36e985e8762373533852bcec10a78434ba8e/5d/9167bdfabd754e97516dcbf2eb48e5/corrected/configs/config.info']" finished abnormally, OS return value: -7
None

Based on other issues this is normally associated with memory issues, but I'm now running wth ~1TB of RAM and it's still happening at the same point, I think possibly related to this:

  0:35:06.762  6933M / 8740M INFO    General                 (concurrent_dsu.cpp        :  64)   Writing down entries

However there is no further error (as seen above, it just says None).

Can you provide any suggestions how to further debug this?

(Note there are upstream malloc warnings, but in other issues I've seen the advice is to ignore them)

spades.log

spades.log

params.txt

params.txt

SPAdes version

v4.0.0

Operating System

Debian GNU/Linux 12 (bookworm)

Python Version

3.12.5

Method of SPAdes installation

docker container (biocontainers)

No errors reported in spades.log

  • Yes
@handesome
Copy link

same error,did you solved it yet?

@jfy133
Copy link
Author

jfy133 commented Nov 5, 2024

No, had it for a while :(

@TrinyEG
Copy link

TrinyEG commented Dec 13, 2024

Any solution to this error?

@jfy133
Copy link
Author

jfy133 commented Dec 13, 2024

Nope :(

@asl
Copy link
Member

asl commented Dec 13, 2024

Nope :(

Your filesystem likely does not support memory mapped files properly. So, you'd need to move scratch directory to something more reliably

@asl asl added the io Input / output (e.g. due to disk storage) errors label Dec 13, 2024
@jfy133
Copy link
Author

jfy133 commented Dec 13, 2024

Nope :(

Your filesystem likely does not support memory mapped files properly. So, you'd need to move scratch directory to something more reliably

That's helpful @asl !

In my case this happens on AWS but with a 'special' filesystem (fusion by seqera), so I will follow up with them about this and see if that cou6be the case :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
io Input / output (e.g. due to disk storage) errors
Projects
None yet
Development

No branches or pull requests

4 participants