Skip to content

Install Local Chatbots locally

Jump to bottom
Samuel Sithakoul edited this page Nov 18, 2023 · 13 revisions

How to add chatbots models

  • Follow the instructions of text-generation-webui to download the repository and launch start_linux.sh, start_windows.bat, start_macos.sh, or start_wsl.bat as indicated.
  • On Huggingface website go to the model page, for example https://huggingface.co/PygmalionAI/pygmalion-2.7b
  • Note the name of the model, for instance PygmalionAI/pygmalion-2.7b
  • In the text-generation-webui window, load the model in the Model tab by writing the precedent name of the model in the Donwload model section.
  • Once the model downloaded, click on Model at the top left and select the model.
  • Several options are made available in text-generation-webui, just be sure to select use_fast if the model you've chosen doesn't have a proper tokenizer which would return an error. Then click load.
Clone this wiki locally