Skip to content

Commit

Permalink
Update qlora.yml - remove max_packed_sequence_len (#1210) [skip ci]
Browse files Browse the repository at this point in the history
  • Loading branch information
7flash authored Jan 26, 2024
1 parent 74c72ca commit 5407ddd
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion examples/cerebras/qlora.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,6 @@ val_set_size: 0.05
adapter: qlora
lora_model_dir:
sequence_len: 2048
max_packed_sequence_len: 2048
lora_r: 16
lora_alpha: 32
lora_dropout: 0.05
Expand Down

0 comments on commit 5407ddd

Please sign in to comment.