Add cookbook to run Outlines on the cloud with Modal

[rlouf]

Based on the example notebook in Modal's example repository. I also added a script that can be run directly in the /examples folder.

[charlesfrye]

Charles from Modal here. This looks like a great demonstration of how Modal's platform and Outlines' tooling can work effectively together!

I have a few comments on framing, but you're free to take or leave them.

and don't have experience or time to set up the necessary cloud infrastructure.

I would instead say "want to be able to quickly and easily provision, configure, and orchestrate cloud infrastructure". Even folks with experience often end up able to move more quickly with Modal, because we don't just simplify (no k8s ingress config, no certs), we also make things faster (faster container builds and boots, hot-reloading development servers).

here an A100 with 80Gb memory

Should be GB.

modal token set

modal setup should give a better first experience.

We then need to define a main function

The function doesn't have to be called main, it just usually is. local_entrypoint does the work that special names like main do in other runtimes, like C/Python.

[charlesfrye]

And let me know if you have any questions!

[rlouf]

Thank you so much @charlesfrye !