Skip to content

Commit

Permalink
Dbrx finetune yaml requires save folder specified to enable autoresume (
Browse files Browse the repository at this point in the history
#1108)

* Update dbrx-full-ft.yaml

* fix
  • Loading branch information
mvpatel2000 authored Apr 12, 2024
1 parent 560012b commit e9b1c6e
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 2 deletions.
1 change: 0 additions & 1 deletion scripts/train/yamls/finetune/dbrx-full-ft.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,6 @@ seed: 17
device_train_microbatch_size: 1
device_eval_batch_size: 1
precision: amp_bf16
autoresume: true
dist_timeout: 3600
expandable_segments: true

Expand Down
1 change: 0 additions & 1 deletion scripts/train/yamls/finetune/dbrx-lora-ft.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,6 @@ seed: 17
device_train_microbatch_size: 1
device_eval_batch_size: 1
precision: amp_bf16
autoresume: true
dist_timeout: 3600
expandable_segments: true

Expand Down

0 comments on commit e9b1c6e

Please sign in to comment.