Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CGMerger throws OutOfMemoryException #427

Open
vigna opened this issue Mar 18, 2022 · 3 comments
Open

CGMerger throws OutOfMemoryException #427

vigna opened this issue Mar 18, 2022 · 3 comments
Labels
bug Something isn't working

Comments

@vigna
Copy link
Contributor

vigna commented Mar 18, 2022

On branch develop, trying to merge with CGMerger the dependencies related to revision fasten://io.7mind.izumi:distage-extension-config_2.12$1.0.6 (id=76535) causes an out-of-memory exception, even using 128GB of RAM.

To replicate, try

echo '+fasten://io.7mind.izumi:distage-extension-config_2.12$1.0.6' | java -Xmx128G eu.fasten.core.search.SearchEngine jdbc:postgresql://monster:5432/fasten_java fastenro /mnt/fasten/data/callable-index/ foo

on monster. Note that the SearchEngine class has no correlation with the problem—it is just an easy way to run CGMerger over the revision above. After about 20 minutes, CGMerger throws the following exception:

Exception in thread "main" java.lang.OutOfMemoryError: Requested array size exceeds VM limit
	at java.base/java.util.Arrays.copyOf(Arrays.java:3689)
	at java.base/java.util.ArrayList.grow(ArrayList.java:238)
	at java.base/java.util.ArrayList.addAll(ArrayList.java:710)
	at eu.fasten.core.merge.CGMerger.getAllChildren(CGMerger.java:757)
	at eu.fasten.core.merge.CGMerger.getAllChildren(CGMerger.java:757)
	at eu.fasten.core.merge.CGMerger.getAllChildren(CGMerger.java:757)
	at eu.fasten.core.merge.CGMerger.getAllChildren(CGMerger.java:757)
	at eu.fasten.core.merge.CGMerger.createUniversalCHA(CGMerger.java:701)
	at eu.fasten.core.merge.CGMerger.<init>(CGMerger.java:222)
	at eu.fasten.core.search.SearchEngine.from(SearchEngine.java:511)
	at eu.fasten.core.search.SearchEngine.fromRevision(SearchEngine.java:479)
	at eu.fasten.core.search.SearchEngine.fromRevision(SearchEngine.java:464)
	at eu.fasten.core.search.SearchEngine.main(SearchEngine.java:736)

Other revisions from the same group id merge without problems.

@vigna vigna added the bug Something isn't working label Mar 18, 2022
@vigna
Copy link
Contributor Author

vigna commented Mar 19, 2022

A similar behavior occurs with id=104122.

@proksch
Copy link
Contributor

proksch commented Mar 19, 2022

This looks indeed like a bug. @ashkboos is on vacation right now, but will look into this as soon as he is back.

@vigna
Copy link
Contributor Author

vigna commented Mar 21, 2022

Also with 1122038, 132690, 132691, and 573488.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants