Skip to content

Commit

Permalink
docs
Browse files Browse the repository at this point in the history
  • Loading branch information
vemonet committed Sep 19, 2023
1 parent 647dec8 commit 1c02693
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 6 deletions.
2 changes: 2 additions & 0 deletions .github/workflows/docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,8 @@ jobs:
type=ref,event=branch,suffix=-gpu
type=semver,pattern={{version}},suffix=-gpu
- run: df -h

- name: Build and push Docker image
id: build-and-push
uses: docker/build-push-action@v4
Expand Down
13 changes: 7 additions & 6 deletions docs/docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ Checkout the demo at [**chat.semanticscience.org**](https://chat.semanticscience
![UI screenshot](/libre-chat/assets/screenshot-light.png)

!!! warning "Early stage"
Development on this project has just started, use it with caution.
Development on this project has just started, use it with caution. If you are looking for more mature projects check out the bottom of this page.

## ℹ️ How it works

Expand Down Expand Up @@ -73,11 +73,12 @@ The web service is deployed using a [**⚡ FastAPI**](https://fastapi.tiangolo.c

All files required for querying the model are stored and accessed locally using [**🦜🔗 LangChain**](https://python.langchain.com): the main model binary, the embeddings and documents to create the vectors, and the [vectorstore](https://python.langchain.com/docs/modules/data_connection/vectorstores/).

## 🗺️ Other projects
## 🗺️ More mature projects

If you are looking for more mature tools to use LLMs locally we recommend to look into those really good projects:
If you are looking for more mature tools to play with LLMs locally we recommend to look into those really good projects:

* [ChatDocs](https://github.com/marella/chatdocs): UI to Chat with your documents offline.
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui): A Gradio web UI for Large Language Models
* [llm](https://github.com/simonw/llm): Python library for interacting with Large Language Models, both via remote APIs and models that can be installed and run on your own machine
* [llm](https://github.com/simonw/llm): Python library for interacting with Large Language Models, both via remote APIs and models that can be installed and run on your own machine, by Simon Willison (checkout their blog [simonwillison.net](https://simonwillison.net), for a lot of really well written articles about LLMs)
* [vLLM](https://github.com/vllm-project/vllm): A high-throughput and memory-efficient inference and serving engine for LLMs (includes OpenAI-compatible server, requires GPU)
* [ChatDocs](https://github.com/marella/chatdocs): UI to Chat with your documents offline, by the developer of [ctransformers](https://github.com/marella/ctransformers)
* [localGPT](https://github.com/PromtEngineer/localGPT): Chat with your documents on your local device using GPT models
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui): A Gradio web UI for Large Language Models

0 comments on commit 1c02693

Please sign in to comment.