December 2024

[mathur-exe]

December 2024 Student Submission

Module Completed

• ✅ Module 1: Instruction Tuning
• Module 2: Preference Alignment
• Module 3: Parameter-efficient Fine-tuning
• Module 4: Evaluation
• Module 5: Vision-language Models
• Module 6: Synthetic Datasets
• Module 7: Inference
• Module 8: Deployment

Changes Made

Describe what you've done in this PR:

1. What concepts did you learn?

• Creating a chat template for a model from different kinds of dataset
• How to use .map in for batchprocess
• Understood the basic script for SFT

2. What changes or additions did you make?

• chat_template: process_data fn for 2 dataset
• SFT: generation code of haiku

4. Any challenges you faced?

• 🚨 Less guidance on how to approach SFT nb

Notebooks Added/Modified

List any notebooks you've added or modified:

• ✅ Added new example in module_name/student_examples/my_example.ipynb
• Modified existing notebook with additional examples
• Added documentation or comments

Checklist

• ✅ I have read the module materials
• ✅ My code runs without errors
• ✅ I have pushed models and datasets to the huggingface hub
• ✅ My PR is based on the december-2024 branch

Questions or Discussion Points

Add any questions you have or points you'd like to discuss:
1.
3.

Additional Notes

Any other information that might be helpful for reviewers:

• Please make the task for SFT notebook a little clear with examples on how to approach the problem