Save BertTopic model to GCS

[MourouzidouElisa]

Hi, I would like to move my BertTopic Model to my google cloud storage. I've saved the model using: topic_model.save("model_one"), I downloaded the file and then uploaded to my GCS but when I do that I cannot use the model (I have a "null" error when I run it). I am trying to find another way to save the model hoping that I'll be able to uploaded and then uploaded it to my GCS after. Is there any other way you suggest to save BertTopic?

Thank you in advance :)

[MaartenGr]

Could you share the exact code for training the model and then loading it? Also, could you share the full error, that will help identify what exactly is happening? Lastly, did you make sure that the environments between saving and loading the model have the same python versions and dependencies?

[MourouzidouElisa]

ah yes sorry, I changed the name afterwards. The screenshot is wrong but the error is the same.

[MaartenGr]

Ah okay, did you also make sure that the python and dependency versions are exactly the same between the environment where you saved the model and where you loaded the model?

[MourouzidouElisa]

Yes, I make sure the environments are the same. I am thinking that the issue is caused when I download the model. What I am doing is: I save the model, I download it from the platform and then upload it again to the same platform but in different instance and then load the model there. Is there any chance that I ruin the model while downloading/uploading it?

[MaartenGr]

Strange, this should not happen if the environments are the same, including whether GPU is enabled or not, etc. I would be quite surprised if downloading and uploading the model would do something to the file. If the file was correctly uploaded, then there should be no problem. Are the sizes of the downloaded and uploaded files the same? Also, it might be worthwhile to re-install BERTopic from a fresh environment to see if that helps. One other thing, I would be a bit surprised but perhaps using python 3.8 might solve your issue.

[MourouzidouElisa]

Ah, the sizes of the initial saved model and the downloaded one are not the same. I dont know why though. I'll probably have to find another way to move the model.