Skip to content
This repository has been archived by the owner on Sep 27, 2024. It is now read-only.

Can't choose GPU when multiple GPUs exist #26

Open
inshua opened this issue Mar 12, 2024 · 8 comments
Open

Can't choose GPU when multiple GPUs exist #26

inshua opened this issue Mar 12, 2024 · 8 comments

Comments

@inshua
Copy link

inshua commented Mar 12, 2024

Here is faraday did:

image

and Jan
image

However I cannot select GPU in LM Studio, and it always use my CPU and memory on board.

@inshua
Copy link
Author

inshua commented Mar 12, 2024

LM studio, v0.2.16
image

@chrisk314
Copy link

I'm also hitting this issue. I'm running on a laptop with an Intel Iris XE GPU integrated with the CPU and a discrete Nvidia GPU. In Windows Task Manager the integrated GPU is GPU:0 and the discrete GPU is GPU:1. I can see from the LM-Studio task in Task Manager that it is using GPU:0, despite the "Detected GPU type" displaying "Nvidia GPU" as in the screenshot from inshua.

Is there a way to configure this via the gpu-preferences.json file?

LM Studio v0.2.17

@chrisk314
Copy link

In my case I resolved the issue by setting the gpuType to nvidia in the gpu-preferences.json file. It was previously set to unknown. I now see GPU:1 GPU memory usage increase in Task Manager when loading the model and the output generation is much faster.

{
  "gpuType": "nvidia",
  "modelFileFormat": "gguf"
}

@inshua
Copy link
Author

inshua commented Mar 27, 2024

In my case I resolved the issue by setting the gpuType to nvidia in the gpu-preferences.json file. It was previously set to unknown. I now see GPU:1 GPU memory usage increase in Task Manager when loading the model and the output generation is much faster.

{
  "gpuType": "nvidia",
  "modelFileFormat": "gguf"
}

You're lucky that 1 GPU is Intel and another is NVDIA.

@Jeevan-J
Copy link

In the latest version 0.2.28, where can we find gpu-preferences.json?

@wgabrys88
Copy link

wgabrys88 commented Jul 29, 2024

In the latest version 0.2.28, where can we find gpu-preferences.json?

"#{HOME}/.cache/lm-studio/gpu-preferences.json"

It may not be there if you have problems with GPU from the start - you will have to create that file manually.

@inshua
Copy link
Author

inshua commented Jul 30, 2024

In the latest version 0.2.28, where can we find gpu-preferences.json?

Do you know how to specify which GPU in this gpu-preferences.json?

@wgabrys88
Copy link

In the latest version 0.2.28, where can we find gpu-preferences.json?

Do you know how to specify which GPU in this gpu-preferences.json?

Hi,
I have tried manually but failed. However, problem is no more - on the latest LM Studio version the iGPU is working again.
They have added Vulcan drivers.

PS.
My suggestion is to download and store somewhere the installer, just in case they will break iGPU in the future :)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants