Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using CompactArray for permutations #56

Open
progval opened this issue Sep 20, 2023 · 1 comment
Open

Using CompactArray for permutations #56

progval opened this issue Sep 20, 2023 · 1 comment

Comments

@progval
Copy link
Contributor

progval commented Sep 20, 2023

speaking of space used for permutations, I just noticed that we could probably halve it in the Software Heritage graph by using CompactArray instead of naive arrays, as we have 34 billion nodes (2^35).

Do you want me to try and see the impact on LLP performance?

@vigna
Copy link
Owner

vigna commented Sep 20, 2023

Well, the only difference should be in the generation and inversion of the permutation. The problem is that CompactArray in the atomic version does not have very strong concurrency guarantees, so you wouldn't be able to use parallel sorting when generating it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants