Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add multi-gpu support #41

Open
egillax opened this issue Oct 18, 2022 · 1 comment
Open

Add multi-gpu support #41

egillax opened this issue Oct 18, 2022 · 1 comment
Labels
enhancement New feature or request
Milestone
2.2

Comments

@egillax
Copy link
Collaborator

egillax commented Oct 18, 2022

It would be good to be able to use multiple-GPUs to train your model. Especially for bigger model such as Transformers and models using temporal data. This is something me and @ted9219 briefly talked about during the OHDSI symposium.
@egillax egillax added the enhancement New feature or request label Oct 18, 2022
@lhjohn
Copy link
Collaborator

lhjohn commented Mar 28, 2023

Various method could speed up model training by spreading training workload across multiple worker nodes.

Data parallelism

Feature not yet available: mlverse/torch has an open issue for implementing DataParallel.

Model parallelism

@lhjohn lhjohn mentioned this issue Mar 28, 2023
Closed
@egillax egillax added this to the 2.1 milestone Dec 21, 2023
@egillax egillax modified the milestones: 2.1, 2.2 Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
2.2
Development

No branches or pull requests
2 participants
@lhjohn @egillax