Feat: Add sharegpt multirole #1137
Conversation
| input_roles = { | ||
| "human", | ||
| "funcresponse", | ||
| "funccaller", | ||
| "tool", | ||
| "tool_response", | ||
| user, | ||
| } | ||
| output_roles = {"gpt", "tool_caller", assistant} |
There was a problem hiding this comment.
Please add your new roles here if you want to use names other than these.
src/axolotl/prompters.py
Outdated
| CONVERSATION_ROLE_FORMAT = { | ||
| "chatml": "<|im_start|>{ROLE}", | ||
| "zephyr": "<|{ROLE}|>", | ||
| } |
There was a problem hiding this comment.
If you want to use a role other than chatml, zephyr, add the role format here. This would then use your from: ___ value into the {ROLE} placeholder.
NanoCode012
force-pushed
the
feat/sharegpt_multirole
branch
from
13f31d8 to
33bcf57
Compare
|
Rebased! For those using this branch earlier, you will need to delete and repull due to rebase. Breaking change: We do not need the How to use: datasets:
- path:
type: sharegpt
conversation: chatml
roles:
input: ['human', 'funcresponse', ...]
output: ['gpt', 'tool_caller', ...]Same as above, only Edit: Waiting for Pydantic PR to be merged. |
Amazing ! Waiting for the merge processing. Is there any timeline here? |
* feat(prompt): support multiple roles for sharegpt * fix: add handling of empty role back * feat: rebased and allowed more dynamic roles via config * fix: variable * chore: update message * feat: add vicuna format * fix: JSON serializable error * fix: typing * fix: don't remap for unknown keys * fix: add roles to pydantic * feat: add test * chore: remove leftover print * chore: remove leftover comment * chore: remove print * fix: update test to use chatml
* feat(prompt): support multiple roles for sharegpt * fix: add handling of empty role back * feat: rebased and allowed more dynamic roles via config * fix: variable * chore: update message * feat: add vicuna format * fix: JSON serializable error * fix: typing * fix: don't remap for unknown keys * fix: add roles to pydantic * feat: add test * chore: remove leftover print * chore: remove leftover comment * chore: remove print * fix: update test to use chatml
See below for update: #1137 (comment)
Description: Allow multiple roles for input and output.
NOTE: Beta and hardcoded values for now!
How to use:
Only supports
conversation: (chatml|zephyr)