Skip to content

Commit

Permalink
🎞️ Fix documentation SFT -max_seq_length instead of max_length (#…
Browse files Browse the repository at this point in the history
  • Loading branch information
skandermoalla authored Jan 18, 2025
1 parent 3555393 commit 76837e8
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/source/reducing_memory_usage.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ training_args = DPOConfig(..., max_completion_length=...)
</hfoption>
<hfoption id="SFT">

SFT truncation is applied to the input sequence via the `max_length` parameter.
SFT truncation is applied to the input sequence via the `max_seq_length` parameter.

<div class="flex justify-center">
<img src="https://huggingface.co/datasets/trl-lib/documentation-images/resolve/main/truncation_input_ids.png" alt="Truncation input ids" width="600"/>
Expand Down Expand Up @@ -92,4 +92,4 @@ training_args = SFTConfig(..., packing=True, max_seq_length=512)

Packing may cause batch contamination, where adjacent sequences influence one another. This can be problematic for some applications. For more details, see [#1230](https://github.com/huggingface/trl/issues/1230).

</Tip>
</Tip>

0 comments on commit 76837e8

Please sign in to comment.