Skip to content

Commit

Permalink
Merge branch 'main' into gen_embedding
Browse files Browse the repository at this point in the history
  • Loading branch information
jalencato authored Oct 13, 2023
2 parents 774187c + 9f52183 commit 017e119
Show file tree
Hide file tree
Showing 19 changed files with 1,099 additions and 131 deletions.
1 change: 1 addition & 0 deletions .github/workflow_scripts/lint_check.sh
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ cd ../../
set -ex

python3 -m pip install --upgrade prospector pip
yes | pip3 install astroid==v3.0.0
FORCE_CUDA=1 python3 -m pip install -e '.[test]' --no-build-isolation
pylint --rcfile=./tests/lint/pylintrc ./python/graphstorm/data/*.py
pylint --rcfile=./tests/lint/pylintrc ./python/graphstorm/dataloading/
Expand Down
86 changes: 84 additions & 2 deletions docs/source/configuration/configuration-run.rst

Large diffs are not rendered by default.

5 changes: 5 additions & 0 deletions docs/source/scale/sagemaker.rst
Original file line number Diff line number Diff line change
Expand Up @@ -160,6 +160,11 @@ Because we are using a three-partition OGB-MAG graph, we need to set the ``--ins

The trained model artifact will be stored in the S3 location provided through the ``--model-artifact-s3`` argument. You can use the following command to check the model artifacts after the training completes.

If you want to resume a saved model checkpoint to do model fine-tuning you can pass
the S3 address of the model checkpoint through the ``--model-checkpoint-to-load``
argument. For example by passing ``--model-checkpoint-to-load s3://mag-model/epoch-2/``,
GraphStorm will initialize the model parameters with the model checkpoint stored in ``s3://mag-model/epoch-2/``.

.. code-block:: bash
aws s3 ls s3://<PATH_TO_SAVE_TRAINED_MODEL>/
Expand Down
2 changes: 2 additions & 0 deletions examples/mag/mag_gnn_nc.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@ gsf:
backend: gloo
verbose: false
save_perf_results_path: null
lm:
cache_lm_embed: true
gnn:
model_encoder_type: rgcn
num_layers: 2
Expand Down
Loading

0 comments on commit 017e119

Please sign in to comment.