This repo serves/wraps databricks/dolly-v2-3b with Jsonformer.
If your running locally:
pip install -r requirements.txt
python app.py
you may want to change the port if there is something else running on that port. Inside the Magick AIDE Jsonformer node you can specify a port.
If your deploying to banana fork this repo and deploy it from their app.
Runpod serverless instructions coming soon