From 909371fdd5800994fa0caac2bba5fa30c641d7cf Mon Sep 17 00:00:00 2001 From: Sifal Date: Tue, 24 Dec 2024 18:01:28 +0100 Subject: [PATCH] updating weights / training model I understood, but I prefer the usual formulation --- 1_instruction_tuning/supervised_fine_tuning.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/1_instruction_tuning/supervised_fine_tuning.md b/1_instruction_tuning/supervised_fine_tuning.md index cdd10607..dc236962 100644 --- a/1_instruction_tuning/supervised_fine_tuning.md +++ b/1_instruction_tuning/supervised_fine_tuning.md @@ -16,7 +16,7 @@ For example, if you're developing a customer service application, you might want ## The Fine-Tuning Process -The supervised fine-tuning process involves training model weights on a task-specific dataset. +The supervised fine-tuning process involves adjusting a model's weights on a task-specific dataset. First, you'll need to prepare or select a dataset that represents your target task. This dataset should include diverse examples that cover the range of scenarios your model will encounter. The quality of this data is important - each example should demonstrate the kind of output you want your model to produce. Next comes the actual fine-tuning phase, where you'll use frameworks like Hugging Face's `transformers` and `trl` to train the model on your dataset.