Integrated sovereign AI chatbot and inference platform combining Open WebUI with the local Ollama LLM engine and LiteLLM unified gateway.
Alle containers in deze suite zijn geconfigureerd met onderlinge netwerken, omgevingsvariabelen en persistente data-opslag.
ollama
Ollama is an open-source, lightweight, and extensible framework for running Large Language Models (LLMs) locally, such as Llama 3, Qwen, Mistral, and DeepSeek.
open-webui
Open WebUI is an extensible, feature-rich, and user-friendly web interface for AI models and LLMs, supporting Ollama and OpenAI-compatible APIs with chat, voice, and RAG capabilities.
litellm
LiteLLM is an AI gateway and LLM proxy that unifies access to 100+ Large Language Models (OpenAI, Gemini, Anthropic, Ollama, Azure, Bedrock, HostYourAI) behind a single OpenAI-compatible API format.
NjordDeploy verzorgt de uitrol van deze multi-container suite via SSH. Compose templates worden automatisch gerenderd en gestart op Docker of Rootless Podman.