GGUF can no longer use GPU?

[TiagoTiago]

I'm not sure if it was something did (been doing way too much at the same time lately and attention and memory haven't been firing on all cylinders lately), or if it was some update to OTGW, or some driver thing or what, but I noticed that GGUF files no longer seem to be using any VRAM at all, and there isn't even the "Use Tensor Cores", or whatever was called, checkbox when loading GGUF files anymore. Does anyone know what could be going on?

ps: CUDA on the base system seems to still be working, Blender sees it just fine and renders with no noticeable artifacts, and GPTQ and AWQ models seem to still use the GPU.

pps: This is on Linux, and I'm starting OTGW as have been for a long while, conda activate oobabooga followed by ./start_linux.sh

[michusx]

I've noticed similar behawior after recent git pull and pip --update. I've checked that installed versions of all llama_cpp_python libraries didn't updated to 0.2.64 despite 'requirements.txt'.
I've updated manually with pip all 3 llama_cpp_python libraries from 'https://github.com/abetlen/llama-cpp-python/releases/' repository and it is working with GPU now...

[TiagoTiago]

Ok, reading up one somethings I'm starting to suspect I might've gotten rusty and forgot some details; gonna see what happens if I delete those two weird envs, and follow the manual Conda instalation procedure again.

[TiagoTiago]

Ok, yep, that start_linux.sh launcher was definetely switching to those one of other envs, doesn't work at all without them there anymore...

[TiagoTiago]

Way too much back and forth with deleting and undeleting files and things that were supposed to be there not being found by the app and then they are and then not once more, and I'm not quite sure how I fixed it. Kinda looks like maybe things do work with the latest version of the package though.

... I need sleep -___-

[TiagoTiago]

Ugh, not sure what changed. Spent a some time not using it, now the problem is back.... Driver update mseed something in mean time perhaps? Gonna try updating ooba and stuff see if anything changes...

Also, ugh, something changed in the meantime and the git merge on updating it triggering vim instead of whatever editor it was using before; the previous one had the important keyboard shortcuts visible at the bottom. I know some people are religious about this shit, but my brain has already too many holes, running out of neurons to memorize new obscure shortcuts.....

[TiagoTiago]

Yeah, updating seems to have fixed the GPU usage