19 lines
440 B
Markdown
19 lines
440 B
Markdown
# ollama / openwebui stack w/ gpu support
|
|
|
|
## models
|
|
|
|
https://ollama.com/library
|
|
|
|
## setup
|
|
|
|
https://hub.docker.com/r/ollama/ollama
|
|
|
|
```bash
|
|
curl -s -L https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo \
|
|
sudo tee /etc/yum.repos.d/nvidia-container-toolkit.repo
|
|
sudo dnf update
|
|
sudo dnf install nvidia-container-toolkit
|
|
sudo nvidia-ctk runtime configure --runtime=docker
|
|
sudo systemctl restart docker
|
|
```
|