Skip to content

Install Local Chatbots locally

Jump to bottom
Samuel Sithakoul edited this page Nov 27, 2023 · 13 revisions

(Refer to this page before 2.0 update)

How to add chatbots models

  • Follow the instructions of text-generation-webui to download the repository and launch start_linux.sh, start_windows.bat, start_macos.sh, or start_wsl.bat as indicated.
  • On Huggingface website go to the model page, for example https://huggingface.co/PygmalionAI/pygmalion-2.7b
  • Note the name of the model, for instance PygmalionAI/pygmalion-2.7b
  • In the text-generation-webui window (available after the launch of the start file at the local URL), load the model in the Model tab by writing the precedent name of the model in the Download model section.
  • Once the model downloaded, click on Model at the top left and select the model.
  • Several options are made available in text-generation-webui, just be sure to select use_fast if the model you've chosen doesn't have a proper tokenizer which would return an error. Then click load.
  • You can customize the character used for the conversation by putting a proper example in the folder characters of text-generation-webui. An example for Monika is available in the Monik.A.I folder named monika.yaml that you can put in the said folder and then select in the text-generation-webui window.
Clone this wiki locally