-
-
Notifications
You must be signed in to change notification settings - Fork 893
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unable to load ORPO dataset in a *.json file #1868
Labels
bug
Something isn't working
Comments
I am also facing the same issue with the following trace:
|
any update? |
Hi @SicariusSicariiStuff thank you for following up! Any chance you can provide us the dataset you are using so we can do deeper testing on it? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Please check that this issue hasn't been reported before.
Expected Behavior
Local dataset to work the same as with loading a dataset from HF hub
Current behaviour
FileNotFoundError: Couldn't find a dataset script at
Steps to reproduce
If you have:
Replace it with the same file locally (parquet\json doesn't matter)
And you'll get :
FileNotFoundError: Couldn't find a dataset script at
Config yaml
Possible solution
Using a similar processing logic as in a loaded dataset from the hub
Which Operating Systems are you using?
Python Version
3.10
axolotl branch-commit
latest release
Acknowledgements
The text was updated successfully, but these errors were encountered: