Note: On macOS, MPS requires Torch nightly.
Usage:
python server.py -p 8080 --model
Call the API using curl:
curl -X POST localhost:8080/generate --data "{ 'prompt': 'def ping_with_back_off():\n ' }"server
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||