tdpeuter/open-webui
tdpeuter/open-webui
1
Fork 0
forked from open-webui/open-webui
Code Issues Pull requests 1 Projects 1 Releases 2 Packages 1 Activity Actions

Adding the missing env variable

Browse source 
ENV RAG_EMBEDDING_MODEL_DEVICE_TYPE="cuda"
This commit is contained in:
Joseph Young 2024-03-20 18:16:11 -04:00
parent 9a8a48b879
commit 9bea40bd40
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
Dockerfile-cuda
View file

@ -32,6 +32,7 @@ RUN npm run build
######## CUDA WebUI backend ######## ######## CUDA WebUI backend ########
FROM --platform=linux/amd64 nvidia/cuda:"$CUDA_VERSION"-devel-ubuntu22.04 AS cuda-build-amd64 FROM --platform=linux/amd64 nvidia/cuda:"$CUDA_VERSION"-devel-ubuntu22.04 AS cuda-build-amd64
#FROM --platform=linux/amd64 cgr.dev/chainguard/pytorch-cuda12:latest AS cuda-build-amd64 # fails with python requirements conflicts #FROM --platform=linux/amd64 cgr.dev/chainguard/pytorch-cuda12:latest AS cuda-build-amd64 # fails with python requirements conflicts
ENV RAG_EMBEDDING_MODEL_DEVICE_TYPE="cuda"
# Set environment variables for NVIDIA Container Toolkit # Set environment variables for NVIDIA Container Toolkit
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 \ ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 \