Sign inSign up

startnow65/ragbase

By startnow65

•Updated over 1 year ago

Completely local RAG with chat UI

Image
0

540

startnow65/ragbase repository overview

⁠Running

docker run --detach --publish 8501:8501 --env OLLAMA_BASE_URL=http://<ollama host>:11434 startnow65/ragbase

⁠Environment variables

NameDescriptionDefault value
STREAMLIT_SERVER_MAX_UPLOAD_SIZEMaximum size of each file to upload for analysis in MB"10"
APP_HOMEUsed as base for app related files"/app"
LLM_EMBEDDINGSModel to use for Embeddings"BAAI/bge-base-en-v1.5"
LLM_RERANKERModel to use for reranking"ms-marco-MiniLM-L-12-v2"
LOCAL_LLMModel to use when using local LLM via Ollama"gemma2:9b"
REMOTE_LLMModel to use when using remote LLM fromm Grok"llama-3.1-70b-versatile"
LLM_TEMPERATUREModel temperature parameter"0.0"
LLM_MAX_TOKENSMax number of tokens for model"8000"
OLLAMA_BASE_URLThe base URL of Ollama. For example http://localhost:11434. When not set, then remote LLM is used via Grok. In this case, GROK_API_KEY must also be set``
DEBUGEnable debug logging"true"
CONVERSATION_MESSAGES_LIMITMax number of conversations with the uploaded files. Set to a negative number to not limits the number of conversations"-1"
GROQ_API_KEYThe API Key to use for Grok""

Tag summary

Content type

Image

Digest

sha256:54a3f7800…

Size

791.7 MB

Last updated

over 1 year ago

docker pull startnow65/ragbase