Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

prompt as class #72

Open
YY-SONG0718 opened this issue Dec 14, 2023 · 2 comments · May be fixed by #77
Open

prompt as class #72

YY-SONG0718 opened this issue Dec 14, 2023 · 2 comments · May be fixed by #77
Assignees
@YY-SONG0718

Comments

@YY-SONG0718
Copy link
Member

YY-SONG0718 commented Dec 14, 2023 •
edited
Loading

We plan to change the prompts (system messages) to a class and make schema-specific inputs as class parameters. This will facilitate improving prompts over time and enable benchmarking across prompts.
@YY-SONG0718 YY-SONG0718 moved this from Todo to In Progress in BioCypher Development Dec 14, 2023
@YY-SONG0718 YY-SONG0718 self-assigned this Dec 14, 2023
YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
first commit #72
5b970e6
YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
first draft of messages.py #72
0eb6f77
YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
improve messages.py and move the primary messages to top #72
782c20b
YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
make primary_messages a dictionary #72
68d0442
YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
improve prompts delimiter #72
43e5bd4
@slobentanzer
Copy link
Contributor

Parent class Prompt, has input space of a message with placeholders (how do we format them)

and a list of elements (of length same as the placeholders) to insert at the placeholders

YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
prompt class #72
f96a4f9
YY-SONG0718 added a commit that referenced this issue Dec 14, 2023
@YY-SONG0718
prompt class abstracted #72
563fc2a
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
SystemPrompt class #72
c50d186
@YY-SONG0718 YY-SONG0718 linked a pull request Dec 15, 2023 that will close this issue
Draft
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
first commit #72
8b9b029
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
first draft of messages.py #72
800dac2
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
improve messages.py and move the primary messages to top #72
fb8a900
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
make primary_messages a dictionary #72
c44e04a
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
improve prompts delimiter #72
b7e79a5
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
prompt class #72
387022d
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
prompt class abstracted #72
e3190f8
YY-SONG0718 added a commit that referenced this issue Dec 15, 2023
@YY-SONG0718
SystemPrompt class #72
63cbee2
@YY-SONG0718 YY-SONG0718 linked a pull request Dec 15, 2023 that will close this issue
Prompt class merge to benchmark #77
Draft
@slobentanzer slobentanzer moved this from In Progress to Todo in BioCypher Development Jan 25, 2024
@slobentanzer slobentanzer moved this from Todo to Ideas in BioCypher Development Jan 25, 2024
@slobentanzer
Copy link
Contributor

Would be most useful in the automated benchmarking matrix, to be able to change the prompts in isolation from the other components of the benchmarking tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@YY-SONG0718 YY-SONG0718

Labels
None yet
Projects
BioCypher Development
Status: Ideas
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Prompt class merge to benchmark biocypher/biochatter
2 participants
@slobentanzer @YY-SONG0718