Skip to content

Commit

Permalink
fix optimizer + fsdp combination in example (#1893)
Browse files Browse the repository at this point in the history
  • Loading branch information
winglian authored Sep 4, 2024
1 parent 4e5400c commit dca1fe4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/llama-3/fft-8b-liger-fsdp.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ wandb_log_model:
gradient_accumulation_steps: 4
micro_batch_size: 2
num_epochs: 1
optimizer: paged_adamw_8bit
optimizer: adamw_torch
lr_scheduler: cosine
learning_rate: 2e-5

Expand Down

0 comments on commit dca1fe4

Please sign in to comment.