Skip to main content

Ollama and Open WebUI

Recorded deployment: CT 106

Ollama runs local language models and Open WebUI provides a browser interface.

Verification example​

ollama list

Run this inside the relevant LXC, after confirming the application is installed and the command applies.

Security and operations​

Restrict model endpoints and web UI to authenticated, trusted users.

Documentation checklist​

  1. Record service purpose and dependencies.
  2. Save a redacted Compose file in Forgejo.
  3. Describe persistent volumes and backups.
  4. Add a health monitor in Uptime Kuma.
  5. Record upgrade and rollback procedures.