Run any open-source LLM, from Mistral 7B to Llama 3, on a remote server as an API endpoint. RemoteGPT is compatible with Google Colab, allowing you to run LLM inference on free cloud compute provided by Colab.
-
Notifications
You must be signed in to change notification settings - Fork 0
thomas097/remote-gpt
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Run any open-source LLM, such as Llama 3 and Mistral 7B, as a Google Colab-compatible API endpoint.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published