Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enabler: fine-tuning api for models #192

Open
kdziedzic68 opened this issue Nov 18, 2024 · 0 comments
Open

enabler: fine-tuning api for models #192

kdziedzic68 opened this issue Nov 18, 2024 · 0 comments
Labels
enabler This enables development of other issue needs discussion Task is under discussion or need more clarification

Comments

@kdziedzic68
Copy link
Collaborator

Feature description

prepare the structure of ragbits.fine-tune package.

some cases that come to mind:

  • distill gpt4o-mini from gpt4 outputs
  • distill local models from openai models
  • distill llama7b from llama70b

etc.

Motivation

For some case specific applications - it may be not enough for users to properly prompt the model and some fine-tuning may be required to achive the desired performance. Even when the prompting succeds with large and expensive models in the specific case users may want to achieve close quality of results with smaller and cheaper models - so the special focus should be put on distillation tasks here.

Additional context

No response

@kdziedzic68 kdziedzic68 added the enabler This enables development of other issue label Nov 18, 2024
@mhordynski mhordynski moved this to Backlog in ragbits Nov 18, 2024
@mhordynski mhordynski added the needs discussion Task is under discussion or need more clarification label Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enabler This enables development of other issue needs discussion Task is under discussion or need more clarification
Projects
Status: Backlog
Development

No branches or pull requests

2 participants