Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement uploading of files for model fine-tuning to OpenAI API #162

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

sweep-ai[bot]
Copy link
Contributor

@sweep-ai sweep-ai bot commented Aug 18, 2023

Description

This PR implements the functionality to upload files for model fine-tuning to the OpenAI API. It adds a new method uploadFineTuneFile to the SoakpProxy class, which uses the OpenAI API's createFile method to upload the file. The purpose is set to 'fine-tune'. Additionally, a new endpoint POST /openai/fine-tunes/upload is added to the OpenaiFinetunesApi class, which handles the HTTP request for file upload and calls the uploadFineTuneFile method in the SoakpProxy class.

To ensure compatibility with the OpenAI API, the uploaded files are converted into JSONL format using Python means. The conversion functionality is added to the OpenaiFilesApi class.

Summary of Changes

  • Added uploadFineTuneFile method to SoakpProxy class to upload files for model fine-tuning to the OpenAI API.
  • Added POST /openai/fine-tunes/upload endpoint to OpenaiFinetunesApi class to handle file upload requests.
  • Added convertToJSONL method to OpenaiFilesApi class to convert uploaded files into JSONL format.

Fixes #153.


To checkout this PR branch, run the following command in your terminal:

git checkout sweep/upload-files-for-fine-tuning

To get Sweep to edit this pull request, leave a comment below or in the code. Leaving a comment in the code will only modify the file but commenting below can change the entire PR.

@sweep-ai sweep-ai bot added the sweep Assigns Sweep to an issue or pull request. label Aug 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sweep Assigns Sweep to an issue or pull request.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Sweep: Implement uploading of files for model fine-tuning to OpenAI API
0 participants