Skip to content

Commit

Permalink
fix readme
Browse files Browse the repository at this point in the history
  • Loading branch information
hamelsmu committed Mar 31, 2024
1 parent 2d19be4 commit 5742e0a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -389,7 +389,7 @@ See [examples](examples) for quick start. It is recommended to duplicate and mod
See [these docs](docs/config.qmd) for all config options.
<details>
<summary> Understanding of batch size and gradient accumulation steps </summary>
<br/>
Gradient accumulation means accumulating gradients over several mini-batches and updating the model weights afterward. When the samples in each batch are diverse, this technique doesn't significantly impact learning.
Expand Down

0 comments on commit 5742e0a

Please sign in to comment.