ollama-openwebui

ollama-openwebui/README.md

@@ -0,0 +1,18 @@
+# ollama / openwebui stack w/ gpu support
+
+## models
+
+https://ollama.com/library
+
+## setup
+
+https://hub.docker.com/r/ollama/ollama
+
+```bash
+curl -s -L https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo \
+  sudo tee /etc/yum.repos.d/nvidia-container-toolkit.repo
+sudo dnf update
+sudo dnf install nvidia-container-toolkit
+sudo nvidia-ctk runtime configure --runtime=docker
+sudo systemctl restart docker
+```