This project use the Alpaca-LoRA (Low-Rank LLaMA Instruct-Tuning) model and turns it into an gRPC service through SimpleAI.
docker build . -t alpaca-7b-service:latestdocker run -it --rm -p 50051:50051 --gpus all alpaca-7b-service:latestalpaca-lora-7B
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||