You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At the moment, the data download operations we use are unclear, poorly documented, and concerningly typed (e.g., dataset can be a string or a Dataset type or None, and we make a lot of in-place modifications that change types without making this clear). We also appear to try to support all types of interfaces and implementations, but make that unclear; e.g., it seems I could initialize a simulation and override our dataset option to (attempt to) download literally any Hugging Face dataset by prefixing it with hf://, though this will fail because the dataset must exist within our Hugging Face repo.
The text was updated successfully, but these errors were encountered:
At the moment, the data download operations we use are unclear, poorly documented, and concerningly typed (e.g.,
dataset
can be a string or aDataset
type orNone
, and we make a lot of in-place modifications that change types without making this clear). We also appear to try to support all types of interfaces and implementations, but make that unclear; e.g., it seems I could initialize a simulation and override ourdataset
option to (attempt to) download literally any Hugging Face dataset by prefixing it withhf://
, though this will fail because the dataset must exist within our Hugging Face repo.The text was updated successfully, but these errors were encountered: