Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pr sadra #393

Merged
merged 18 commits into from
Nov 20, 2024
Merged

Pr sadra #393

merged 18 commits into from
Nov 20, 2024

Conversation

clefourrier
Copy link
Member

@clefourrier clefourrier commented Nov 18, 2024

Adapting #241 so that it fits what we need in lighteval.
@sadra-barikbin can you tell me if anything's missing?

src/lighteval/tasks/default_prompts.py Outdated Show resolved Hide resolved
src/lighteval/tasks/requests.py Show resolved Hide resolved
@clefourrier clefourrier merged commit e25af7b into main Nov 20, 2024
2 checks passed
@sadra-barikbin
Copy link
Contributor

Adapting #241 so that it fits what we need in lighteval. @sadra-barikbin can you tell me if anything's missing?

Sorry I was busy a few days. Looks great. Just a unit test and a docstring typo in prompt_manager.py:92 is left. I'll send a follow-up if you will.

@clefourrier
Copy link
Member Author

Thanks a lot, yes please do :)

JoelNiklaus pushed a commit to JoelNiklaus/lighteval that referenced this pull request Nov 25, 2024

---------

Co-authored-by: Sadra Barikbin <[email protected]>
Co-authored-by: Nathan Habib <[email protected]>
JoelNiklaus pushed a commit to JoelNiklaus/lighteval that referenced this pull request Nov 26, 2024

---------

Co-authored-by: Sadra Barikbin <[email protected]>
Co-authored-by: Nathan Habib <[email protected]>
hynky1999 pushed a commit that referenced this pull request Nov 29, 2024

---------

Co-authored-by: Sadra Barikbin <[email protected]>
Co-authored-by: Nathan Habib <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants