Conversation on mobile - Pathway to "HER"

[HappyCatKitten]

Would be cool to eventually have the following

Thin mobile client that can stream audio between your server
Whisper
LLM chat
TTS with real emotion

[oobabooga]

I guess that would be the chat mode endgame.

[pbosh]

Eleven Labs is currently the best TTS for emotion. I also used Sonantic for a year or so (even in some commercial projects) until they got bought by Spotify.

[oobabooga]

There is an elevenlabs extension already: https://github.com/oobabooga/text-generation-webui/wiki/Extensions#examples

There is also a whisper extension in the works: #207

And a PR for autoplaying the TTS outputs: #192