v0.2.0 - Harbor App

[av]

v0.2.0 - Harbor App

Harbor App is a companion application for Harbor - a toolkit for running AI locally. It's built on top of functionality provided by the harbor CLI and is intended to complement it.

The app provides clean and tasteful UI to aid with workflows associated with running a local AI stack.

• 🚀 Manage Harbor stack and individual services
• 🔗 Quickly access UI/API of a running service
• ⚙️ Manage and switch between different configurations
• 🎨 Aestetically pleasing UI with plenty of built-in themes

Demo

2024-09-29.17-22-06.mp4

In the demo, Harbor App is used to launch a default stack with Ollama and Open WebUI services. Later, SearXNG is also started, and WebUI can connect to it for the Web RAG right out of the box. After that, Harbor Boost is also started and connected to the WebUI automatically to induce more creative outputs. As a final step, Harbor config is adjusted in the App for the klmbr module in the Harbor Boost, which makes the output unparseable for the LLM (yet still undetstandable for humans).

Installation

Please refer to the Installation Guide

---

This discussion was created from the release v0.2.0 - Harbor App.

[av]

This is a very first release of the Harbor App, things might not work as expected - don't hesitate to post

[SimonBlancoE]

Can you clarify if the app can be accessed remotely via a web interface? If not, is there any plan to implement it?

Right now I can remote desktop into my server, but in case I couldn't, I'd like to know if it's possible.