You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It looks like this function is calling load_from_huggingface for each PEP you want to standardize. While huggingface does cache the model files on disk.. it's very unnecessary to load the model from disk for each PEP you want to standardize.
I would really recommend creating some class that holds the model in memory and can be called many times over for many PEPs:
This will rear its head for the first user to use the standardizer on a public server since it downloads the model not when the server starts up but when the user requests the standardization pipeline
I was following the READNE's instructions:
It looks like this function is calling
load_from_huggingface
for each PEP you want to standardize. While huggingface does cache the model files on disk.. it's very unnecessary to load the model from disk for each PEP you want to standardize.I would really recommend creating some class that holds the model in memory and can be called many times over for many PEPs:
The text was updated successfully, but these errors were encountered: