Skip to content

Commit

Permalink
[shardformer] add 3d plugin to ci test
Browse files Browse the repository at this point in the history
  • Loading branch information
flybird11111 authored Sep 4, 2023
1 parent b01febe commit 5447d85
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/language/bert/test_ci.sh
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,6 @@ set -xe

pip install -r requirements.txt

for plugin in "torch_ddp" "torch_ddp_fp16" "gemini" "low_level_zero"; do
for plugin in "torch_ddp" "torch_ddp_fp16" "gemini" "low_level_zero" "hybrid_parallel"; do
torchrun --standalone --nproc_per_node 4 finetune.py --target_f1 0.86 --plugin $plugin --model_type "bert"
done

0 comments on commit 5447d85

Please sign in to comment.