Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat]: Python StreamLit boilerplate for running AI models. #36

Open
1 task done
PlebeiusGaragicus opened this issue Dec 19, 2023 · 1 comment
Open
1 task done

Comments

@PlebeiusGaragicus
Copy link

Prerequisites

  • I have searched for existing issues that already suggest this feature.

Describe the Feature Request

A template python StreamLit application - a boilerplate, really.

Describe the Use Case

This allows me to prototype custom per-use-case AI applications, open source and written by me, connected to my own self-hosted AI compute or to paid API's (OpenAI, et al.).

Ideally one day, these can be PWA's and written in SvelteKit, self-hosted from my node.

Describe Preferred Solution

This can be an example repo with all the needed StartOS files. Ideally this would be a monolith repo, not pulling from a docker image. The Python code would be included and it would all be made into an .s9pk with a make command. This way I can build from source on my machine with no outside internet needed and upload to my own node.

Describe Alternatives

I have considered learning frontend web frameworks, but as my time is limited and my skills are more in AI and python... I am very very limited by mostly knowing Python.

But Python is a valid choice and many plebs starting out may only know one language. This allows many like me to build a self-hosted AI application on my own StartOS node from reclaimed hardware.

One day this should be built, by someone.

Anything else?

Screenshot 2023-12-18 at 5 21 36 PM

StartOS should enable everyone to run their own AI models!

@PlebeiusGaragicus
Copy link
Author

The screenshot is me fucking with the model, btw 🤣

I'd love to give a bounty for this. I understand that StartOS will be updated and the dev experience will improve - but sooner or later we need this!

I will put up 150,000 sats.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant