You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Specifically MLX only supports some weight file formats (safetensors and nfz I think?). We currently only check architecture which means you sometimes get a "No safetensors for..." error when trying to run a model with MLX.
There are several possible ways to address:
check weight file formats (currently there is a formats array in model gallery)
use allow_patterns to see if there's a supported file type (lots of reasons this might not work)
take advantage if we add MLX field to models that says minimum version required to support like transformers (separate issue)
create some other way for a plugin to take a model and return if it's supported (kind of ugly but more flexible)
The text was updated successfully, but these errors were encountered:
We tried options that added a field to gallery models that sort of worked, but most users are importing models either from their drive or HuggingFace. So we will need to figure out how to detect this automatically in the code that generates the list of possible engines (and then possibly also needs to show somewhere why, for example, MLX isn't available if it is a standard Hugging Face modeal and you are on a Mac?)
Specifically MLX only supports some weight file formats (safetensors and nfz I think?). We currently only check architecture which means you sometimes get a "No safetensors for..." error when trying to run a model with MLX.
There are several possible ways to address:
The text was updated successfully, but these errors were encountered: