Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

iPCA hangs #26

Open
jdrusso opened this issue Oct 18, 2022 · 2 comments
Open

iPCA hangs #26

jdrusso opened this issue Oct 18, 2022 · 2 comments
Labels
bug Something isn't working

Comments

@jdrusso
Copy link
Owner

jdrusso commented Oct 18, 2022

  • msm_we version: 0.27
  • Python version: 3.9.13
  • Operating System: Ubuntu 20.04

iPCA/PCA occasionally hangs indefinitely during model-building
@jdrusso
Copy link
Owner Author

jdrusso commented Oct 18, 2022

Implemented batch-PCA in 2c1dbe6... Not really an ideal solution to eliminate streaming, but it works.

@jdrusso jdrusso added the bug Something isn't working label Oct 18, 2022
@jdrusso
Copy link
Owner Author

jdrusso commented Oct 25, 2022 •
edited
Loading

Addressed by 2202aaa . This isn't a perfect solution, but it's a start

At its core, this issue comes from sklearn oversubscribing threads. I can't find any other way to specify the number of threads to it automatically. Ideally, it should match the number of RAY workers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jdrusso