docker_dev_stacks/ollama-openwebui

ollama / openwebui stack w/ gpu support

models

https://ollama.com/library

setup

https://hub.docker.com/r/ollama/ollama

curl -s -L https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo \
  sudo tee /etc/yum.repos.d/nvidia-container-toolkit.repo
sudo dnf update
sudo dnf install nvidia-container-toolkit
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker