Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding new models in the model list #21

Open
sreenivasraghavan71 opened this issue May 10, 2024 · 4 comments
Open

Adding new models in the model list #21

sreenivasraghavan71 opened this issue May 10, 2024 · 4 comments

Comments

@sreenivasraghavan71
Copy link

Hi,
I have a finetuned model and it's gguf format. Can someone guide on how to add this model and access it using lmstudio windows version and lmstudio js?

@yagil
Copy link
Member

yagil commented May 10, 2024

Hi @sreenivasraghavan71 , since the model is already in GGUF format all you have to do is place it in LM Studio's working models directory.

LM Studio expects this directory structure for every model:

${Publisher}/${Repository}/${ModelFile}

How to add an existing GGUF:

  1. Head to your 📂My Models tab within LM Studio
  2. On the top-left you'll see something like this
image
  1. Go to this folder in your File Explorer and place the model there in the expected sub-directory path:
path-to-models-dir-here/sreenivasraghavan71/my-cool-model/model.gguf

P.S. we will make it easier to do in one go: lmstudio-ai/lms#20

@brentrayward
Copy link

copy the file name including the gguf on the end make a folder and have it with the same name and then put your model in the folder this is what worked for me

@brentrayward
Copy link

Hi @sreenivasraghavan71 , since the model is already in GGUF format all you have to do is place it in LM Studio's working models directory.

LM Studio expects this directory structure for every model:

${Publisher}/${Repository}/${ModelFile}

How to add an existing GGUF:

  1. Head to your 📂My Models tab within LM Studio
  2. On the top-left you'll see something like this
image 3. Go to this folder in your File Explorer and place the model there in the expected sub-directory path:
path-to-models-dir-here/sreenivasraghavan71/my-cool-model/model.gguf

P.S. we will make it easier to do in one go: lmstudio-ai/lms#20

No this doesn't work I have tried this the only way it works is making a folder with the same file name

@Sawa121212
Copy link

сmd:
lms import "{filepath}/{modelName}.gguf"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants