open-webui/INSTALLATION.md

36 lines
641 B
Markdown
Raw Permalink Normal View History

2024-02-17 09:07:43 +01:00
### Installing Both Ollama and Open WebUI Using Kustomize
2024-01-01 00:10:33 +01:00
For cpu-only pod
```bash
kubectl apply -f ./kubernetes/manifest/base
```
For gpu-enabled pod
```bash
kubectl apply -k ./kubernetes/manifest
```
2024-02-17 09:07:43 +01:00
### Installing Both Ollama and Open WebUI Using Helm
2024-01-01 00:10:33 +01:00
Package Helm file first
```bash
helm package ./kubernetes/helm/
```
For cpu-only pod
```bash
helm install ollama-webui ./ollama-webui-*.tgz
```
For gpu-enabled pod
```bash
helm install ollama-webui ./ollama-webui-*.tgz --set ollama.resources.limits.nvidia.com/gpu="1"
```
Check the `kubernetes/helm/values.yaml` file to know which parameters are available for customization