Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Dataset Presets #76

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Add Dataset Presets #76

wants to merge 2 commits into from

Conversation

i-shiang
Copy link
Collaborator

No description provided.

@i-shiang i-shiang linked an issue Jul 11, 2024 that may be closed by this pull request
Copy link

codesandbox bot commented Jul 11, 2024

Review or Edit in CodeSandbox

Open the branch in Web EditorVS CodeInsiders

Open Preview

@i-shiang i-shiang linked an issue Jul 11, 2024 that may be closed by this pull request
@i-shiang i-shiang requested a review from ThePyProgrammer July 11, 2024 15:49
@i-shiang i-shiang self-assigned this Jul 11, 2024
@ThePyProgrammer ThePyProgrammer changed the title Add Presets Add Dataset Presets Jul 18, 2024
Copy link
Member

@ThePyProgrammer ThePyProgrammer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay lah just fix the name, add support for subsets and make a method in HuggingFaceDataset and HuggingFaceDatasetAlias that loads these presets

@@ -173,7 +173,7 @@ def convert(self, sample: dict) -> SystemAssistedPrompt:
)


class JudgeQuestioningDataset(_HuggingFaceDataset[JudgeQuestioningPrompt]):
class JudgeQuestioningsafeteDataset(_HuggingFaceDataset[JudgeQuestioningPrompt]):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is safete lmao, remove!

@@ -0,0 +1,3 @@
name: walledai/SafetyDatasets
split: train
type: Prompt
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where are my subsets bro, this one got lots of subsets hehe

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants