The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Text-To-Speech, RAG, and LLMs. All local!

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.

"Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp and provides a convenient and straightforward way to perform inference using local language models.

llama.cpp gguf file parser for javascript

A frontend for large language models like 🐨 Koala or 🦙 Vicuna running on CPU with llama.cpp, using the API server library provided by llama-cpp-python. NOTE: I had to discontinue this project because its maintenance takes more time than I can and want to invest. Feel free to fork :)

Refactor your code with local LLM in VSCode

A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, including OpenAI, Anthropic, Google Gemini, Cohere, Hugging Face Inference, NVIDIA AI, Mistral AI, AI21 Studio, LLaMA.CPP, and Ollama, and hundreds of models.

Function Calling LLMs that run locally on device.

Metatron is a project that brings together whisper.cpp, llama.cpp, and piper into a deployable stack with an awesome Node.js API wrapper for each of them.

Self-hosted chat UI for running Alpaca models locally, built with MERN stack and based on llama.cpp

An open-source AI app | running mixtral 8x7B / llama.cpp | single-layer threads interface | multi-user | private | offline capable

A local AI helper in your terminal. Invoke from the command line to get help on your previous command(s). You need to be writing your history to some file and it will grab the last N lines and provide helpful information based on that.

Messenger-like AI chat app that can run locally using Llama cpp and Stable Diffusion.

A website for chatting with AI characters locally or with chat-gpt easily.

run llama models using llamafile and communicate with llama models through javascript. in this repo "tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf" model was used but you can replace it with any gguf model.