Install Local Chatbots locally

Jump to bottom

Samuel Sithakoul edited this page Nov 27, 2023 · 13 revisions

(Refer to this page before 2.0 update)

How to add chatbots models

Follow the instructions of text-generation-webui to download the repository and launch start_linux.sh, start_windows.bat, start_macos.sh, or start_wsl.bat as indicated.
On Huggingface website go to the model page, for example https://huggingface.co/PygmalionAI/pygmalion-2.7b

Note the name of the model, for instance PygmalionAI/pygmalion-2.7b
In the text-generation-webui window (available after the launch of the start file at the local URL), load the model in the Model tab by writing the precedent name of the model in the Download model section.

Once the model downloaded, click on Model at the top left and select the model.
Several options are made available in text-generation-webui, just be sure to select use_fast if the model you've chosen doesn't have a proper tokenizer which would return an error. Then click load.