enabler: fine-tuning api for models #192
Labels
enabler
This enables development of other issue
needs discussion
Task is under discussion or need more clarification
Feature description
prepare the structure of ragbits.fine-tune package.
some cases that come to mind:
etc.
Motivation
For some case specific applications - it may be not enough for users to properly prompt the model and some fine-tuning may be required to achive the desired performance. Even when the prompting succeds with large and expensive models in the specific case users may want to achieve close quality of results with smaller and cheaper models - so the special focus should be put on distillation tasks here.
Additional context
No response
The text was updated successfully, but these errors were encountered: