A self-hosted AI toolkit: Ollama to run models, Open WebUI as the chat front-end, Qdrant as the vector store for RAG, and Flowise to build LLM apps and agents low-code.
nomad-pack registry add nomploy github.com/Nomploy/nomad-packs nomad-pack run ollama --registry nomploy nomad-pack run open-webui --registry nomploy nomad-pack run qdrant --registry nomploy nomad-pack run flowise --registry nomploy
Ollama — run open large language models (Llama, Mistral, Gemma, Qwen, and more) locally behind a simple REST API. Deployed as a host-networked Nomad service with a persistent Docker volume for downloaded models.
Open WebUI — a feature-rich, self-hosted ChatGPT-style web interface for local LLMs (Ollama) and OpenAI-compatible APIs, with chats, RAG, and user management. Deployed as a host-networked Nomad service with a persistent volume; pairs with the ollama pack.
Qdrant — an open-source vector database and similarity-search engine for embeddings, powering semantic search and RAG. Deployed as a host-networked Nomad service with a persistent volume; pairs with the ollama pack for a self-hosted AI stack.
Flowise — a low-code, drag-and-drop builder for LLM apps and agents: chains, RAG pipelines, tools, and chatbots you can embed or call via API. Deployed as a single host-networked Nomad service with a data volume and optional app login. Pairs with the ollama and qdrant/weaviate packs.
Highlighted variables are placeholders (passwords, secret keys) you should change before production. Open a pack for its full variable table and a copy-paste values.hcl.