forloopse/alpaca-webui repository overview

⁠Alpaca WebUI

Alpaca WebUI, initially crafted for Ollama⁠, is a chat conversation interface featuring markup formatting and code syntax highlighting. It supports a variety of LLM endpoints through the OpenAI Chat Completions API and now includes a RAG (Retrieval-Augmented Generation) feature, allowing users to engage in conversations with information pulled from uploaded documents.

The app lets you easily try out different AI models from various services to find answers using your documents. It simplifies mixing and matching these models to see which one works best for your needs.

Has

• Support for your local or remote Ollama⁠ server
• Compatible with OpenAI Chat Completions API
• Workes with OpenAI⁠, Together.ai⁠, Mistral.ai⁠, Groq.com⁠ and Ollama⁠
• Upload document (pdf, txt, docx) for RAG usage
• Modify System Prompt for Chat and RAG
• Markup Formatting
• Code Syntax Highlighting
• List available models for services supporting OpenAI API model endpoint (and listing of Ollama models)
• Mobile-Friendly and Desktop-Friendly Layout
  

⁠Run with the following command:

Download and run the following docker compose file: https://github.com/mmo80/alpaca-webui/blob/main/docker-compose.yml⁠

docker compose up --detach

This command sets up two containers: one for the app and another for the Weaviate⁠ vector database. (Please note that there is no data persistence on a mapped volume in this configuration.)

Github:
https://github.com/mmo80/alpaca-webui⁠