Always prompted I couldn't find “nexa.gguf”

[zhang10311105]

from nexa.gguf import NexaVLMInference, NexaTextInference # Import model classes
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'nexa.gguf'

[robertsamples]

I had this problem and was able to fix it. I don't know exactly what things were critical but what I did was

I installed the cuda version of nexa since I have an nvidia gpu:
pip install nexaai --prefer-binary --index-url https://github.nexa.ai/whl/cu124 --extra-index-url https://pypi.org/simple --no-cache-dir

installed nexa SDK via the windows installer (the nexa repo is linked in the readme)

whenever I got an error (for llama.dll for instance) I pulled the files from the nexa sdk folder (C:\Users[username]\AppData\Local\Nexa-SDK_internal) and put them in the python environment packages folder for nexa (C:\Users[username]\anaconda3\envs\local_file_organizer\Lib\site-packages\nexa). I had to do this for some of the other DLLs for gguf I think, I just copied over all files that werent in the directory already.

Then I got an error for punkt tab being missing. There will be a message in the terminal telling you how to fix this and I just followed that and now it seems to be working.