Skip to content

Latest commit

 

History

History
15 lines (8 loc) · 296 Bytes

README.md

File metadata and controls

15 lines (8 loc) · 296 Bytes

Python server

Note: On macOS, MPS requires Torch nightly.

Usage:

python server.py -p 8080 --model

Call the API using curl:

curl -X POST localhost:8080/generate --data "{ 'prompt': 'def ping_with_back_off():\n  ' }"