Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Multi-task Learning] Add support for multi-task learning #842

Merged
merged 103 commits into from
May 31, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
103 commits
Select commit Hold shift + click to select a range
a59b038
Drafting multi-task learning
May 3, 2024
8825cb1
Update
May 3, 2024
82489ed
Update
May 6, 2024
3efbaa1
Update gsf
May 6, 2024
e82da16
Update
May 6, 2024
9a8f8b4
update
May 6, 2024
00f1211
Update
May 6, 2024
e8573e4
Merge branch 'master' into multi-task-trainer
May 7, 2024
2813d3a
Update
May 7, 2024
20d306a
update
May 9, 2024
9613c6a
Update
May 9, 2024
166d9d5
Update
May 9, 2024
ab62c45
Add unit tests
May 9, 2024
b6a7267
Fix bugs
May 10, 2024
71ad941
Fix CI
May 10, 2024
6e7c93e
[Multi-task Learning] Update GraphStorm input config to support multi…
classicsong May 11, 2024
6344f91
Merge branch 'multi-task' into multi-task-trainer
May 11, 2024
75b5435
Update
May 13, 2024
729a5e1
Update
May 13, 2024
515a642
update
May 13, 2024
23c24ca
Add test
May 13, 2024
3c86ab3
Fix
May 13, 2024
e541837
update
May 14, 2024
1dcc4aa
add test for evaluator
May 14, 2024
1335ce1
Update multi-task evaluator
May 14, 2024
75a6608
Merge branch 'main' into multi-task
classicsong May 15, 2024
e8584db
[Multi-task Learning] Add multi-task Dataloader for multi-task learni…
classicsong May 15, 2024
d4a74a9
Add movielens test data
May 15, 2024
858b751
update
May 15, 2024
9de160b
Update
May 15, 2024
0c630ce
Update
May 15, 2024
1d58bee
[Multi-task Learning] Add multi-task evaluator for multi-task learnin…
classicsong May 15, 2024
771adf7
Add multi-task entry point
May 15, 2024
c79b15b
Merge branch 'multi-task' into multi-task-trainer
May 15, 2024
0d9f30d
Update
May 15, 2024
6ca1d65
Fix some bugs
May 16, 2024
fa8111c
[Multi-task Learning] Add Multi-task test dataset (#843)
classicsong May 16, 2024
1fba83a
Merge branch 'multi-task' into multi-task-trainer
May 16, 2024
b265660
Update
May 16, 2024
3b6f8bf
Update
May 16, 2024
3775b94
Update
May 16, 2024
5c41c8a
Fix some bugs
May 16, 2024
25f4817
Fix bugs
May 16, 2024
216c610
Update
May 17, 2024
017c00f
Update
May 17, 2024
bcb9d1d
Merge branch 'master' into multi-task
May 19, 2024
32d905f
Merge branch 'multi-task' into multi-task-trainer
May 19, 2024
5db0f74
Merge branch 'master' into multi-task
May 20, 2024
a778c08
Merge branch 'multi-task' into multi-task-trainer
May 20, 2024
3b592c4
clean up duplicated code
May 20, 2024
d7e0405
Update
May 20, 2024
08e3fe6
update init
May 20, 2024
4945c2c
update ep_gnn.py
May 20, 2024
d0b37b4
update lp_gnn.py
May 20, 2024
46da6ca
update
May 20, 2024
1dc4dcc
update
May 20, 2024
9b19427
update
May 20, 2024
28ec04c
Add unitests
May 21, 2024
2675b6d
Update docstr
May 21, 2024
775d4b2
Update
May 21, 2024
44c5357
update
May 21, 2024
c719891
Add test
May 21, 2024
958e2b9
Update
May 21, 2024
78f3458
[Multi-task Learning] Refactor graphstorm.model for multi-task learni…
classicsong May 21, 2024
87e1df2
Merge branch 'multi-task-refactor-nn' into multi-task-trainer
May 21, 2024
4f56db3
Merge branch 'multi-task' into multi-task-trainer
classicsong May 21, 2024
04ec3e9
Add test for multitask_gnn.py
May 23, 2024
601aa1b
Add GSgnnMultiTaskSharedEncoderModel
May 23, 2024
4a3ec01
Add unitests
May 23, 2024
46125ca
Update
May 23, 2024
2403930
update dataloader
May 23, 2024
caa851a
Fix lint
May 23, 2024
e3e33f8
Fix lint
May 24, 2024
36f4c60
update
May 24, 2024
3543281
Merge branch 'multi-task-model' into multi-task-trainer
May 24, 2024
4a0a7df
Fix DDP bug
May 24, 2024
424b4b2
Update
May 24, 2024
f62e035
update
May 24, 2024
d8dd046
update test
May 24, 2024
1a5a165
Update
May 24, 2024
1d92008
Update
May 24, 2024
d6c2cb3
Update
May 24, 2024
c90fb5f
Update
May 26, 2024
3a98131
Update
May 26, 2024
9baac44
Update
May 27, 2024
6003cdc
update
May 27, 2024
a7c14e3
Update
May 27, 2024
2a9aa88
Fix lint
May 27, 2024
fc45ea2
Fix lint
May 27, 2024
fd509c9
Merge branch 'multi-task-model' into multi-task-trainer
May 27, 2024
7f9947c
Update
May 27, 2024
2da6621
update
May 28, 2024
b5add94
[Multi-task Learning] Add GSgnnMultiTaskSharedEncoderModel (#855)
classicsong May 28, 2024
bdd41cb
Merge branch 'multi-task' into multi-task-trainer
May 28, 2024
2818176
Update
May 28, 2024
0340223
Update
May 29, 2024
6442b60
Update
May 29, 2024
0e7c660
Update
May 30, 2024
8ffeea6
update
May 30, 2024
062cde0
[Multi-task Learning] Add multi-task trainer (#849)
classicsong May 30, 2024
14a49a0
update
May 31, 2024
0303ceb
Merge branch 'multi-task-trainer' into multi-task
May 31, 2024
bf54305
Update
May 31, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflow_scripts/e2e_mgpu_check.sh
Original file line number Diff line number Diff line change
Expand Up @@ -10,4 +10,5 @@ sh ./tests/end2end-tests/create_data.sh
bash ./tests/end2end-tests/graphstorm-lp/mgpu_test.sh
bash ./tests/end2end-tests/graphstorm-nc/mgpu_test.sh
bash ./tests/end2end-tests/graphstorm-ec/mgpu_test.sh
bash ./tests/end2end-tests/graphstorm-mt/mgpu_test.sh

5 changes: 5 additions & 0 deletions python/graphstorm/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,5 +28,10 @@
from .gsf import create_builtin_lp_model
from .gsf import create_builtin_edge_model
from .gsf import create_builtin_node_model
from .gsf import create_task_decoder

from .gsf import (create_builtin_node_decoder,
create_builtin_edge_decoder,
create_builtin_lp_decoder)
from .gsf import (get_builtin_lp_train_dataloader_class,
get_builtin_lp_eval_dataloader_class)
2 changes: 2 additions & 0 deletions python/graphstorm/config/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -46,3 +46,5 @@
BUILTIN_LP_LOSS_CONTRASTIVELOSS)
from .config import (GRAPHSTORM_LP_EMB_L2_NORMALIZATION,
GRAPHSTORM_LP_EMB_NORMALIZATION_METHODS)

from .config import TaskInfo
Loading
Loading