Fully local & open source AI Waifu. VTube Studio, Discord, Minecraft, custom made RAG (long term memory), alarm, and plenty more! Has a WebUI and hotkey shortcuts.
Uses Oobabooga, RVC, and Whisper to run AI.
Requires;
- Windows 10/11
- ~11 GB VRAM (Reccomended 16GB)
YouTube Install Tutorial:
Here is some documentation that you can look at. I am still in the process of making tutorials and documentation!
Credit to this other AI waifu project for making the original base code/skeleton used here!
- Make the RAG/Long Term Memory be multiprocessed for better performance
- Fix repetition issues at the end of speech to text Whisper by manually removing
- Look more into optimal LLMs and configs
- Re-Add support for multimodal A.K.A. support for sending images
- Fix issues where leaving the bot on for a while can cause a bit more lag between messages