open-webui/INSTALLATION.md
2023-12-31 15:10:33 -08:00

647 B

Installing Both Ollama and Ollama Web UI Using Kustomize

For cpu-only pod

kubectl apply -f ./kubernetes/manifest/base

For gpu-enabled pod

kubectl apply -k ./kubernetes/manifest

Installing Both Ollama and Ollama Web UI Using Helm

Package Helm file first

helm package ./kubernetes/helm/

For cpu-only pod

helm install ollama-webui ./ollama-webui-*.tgz

For gpu-enabled pod

helm install ollama-webui ./ollama-webui-*.tgz --set ollama.resources.limits.nvidia.com/gpu="1"

Check the kubernetes/helm/values.yaml file to know which parameters are available for customization