Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WholeGraph] Add support of using WholeGraph to store/load cache_lm_emb #737

Merged
merged 16 commits into from
Feb 20, 2024

Conversation

chang-l
Copy link
Collaborator

@chang-l chang-l commented Feb 14, 2024

Ready to review
Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@chang-l chang-l marked this pull request as ready for review February 14, 2024 23:11
@thvasilo thvasilo added documentation Improvements or additions to documentation and removed documentation Improvements or additions to documentation labels Feb 14, 2024
@zheng-da
Copy link
Contributor

everything else looks good to me.

python/graphstorm/config/argument.py Outdated Show resolved Hide resolved
python/graphstorm/model/lm_embed.py Show resolved Hide resolved
python/graphstorm/model/utils.py Outdated Show resolved Hide resolved
python/graphstorm/model/utils.py Show resolved Hide resolved
Copy link
Contributor

@classicsong classicsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add 2 end2end tests? (one for create wg LMCache another for loading it.) You can add it in the lp mgpu test. There should be one for DistDGLTensor LMCache example.

python/graphstorm/config/argument.py Outdated Show resolved Hide resolved
python/graphstorm/model/utils.py Outdated Show resolved Hide resolved
@classicsong classicsong added the ready able to trigger the CI label Feb 19, 2024
Copy link
Contributor

@classicsong classicsong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@classicsong classicsong merged commit 9ac3df7 into awslabs:main Feb 20, 2024
6 checks passed
classicsong pushed a commit that referenced this pull request Feb 21, 2024
This is to address the concern brought up here:
#737 (comment).
It changes the flag name `use-wholegraph-sparse-emb` -->
`use-wholegraph-embed`, in consistent with
#737.

*Issue #, if available:*

*Description of changes:*


By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.
jalencato pushed a commit that referenced this pull request Feb 21, 2024
This is to address the concern brought up here:
#737 (comment).
It changes the flag name `use-wholegraph-sparse-emb` -->
`use-wholegraph-embed`, in consistent with
#737.

*Issue #, if available:*

*Description of changes:*


By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready able to trigger the CI
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants