(Reskinned) User-friendly WebUI for LLMs (Formerly Ollama WebUI) https://chat.depeuter.dev
ai
Go to file
Tibo De Peuter 71dd9bcbe5
Release / release (push) Failing after 39s Details
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Failing after 21s Details
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Failing after 9s Details
Create and publish Docker images with specific build args / merge-main-images (push) Has been skipped Details
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Failing after 44s Details
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Failing after 25s Details
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been skipped Details
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Failing after 25s Details
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Failing after 26s Details
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been skipped Details
Python CI / Format Backend (3.11) (push) Successful in 40s Details
Frontend Build / Format & Build Frontend (push) Successful in 1m50s Details
Integration Test / Run Cypress Integration Tests (push) Failing after 12m2s Details
Integration Test / Run Migration Tests (push) Failing after 37s Details
Merge remote-tracking branch 'upstream/main'
2024-05-04 18:01:49 +02:00
.github Merge remote-tracking branch 'upstream/main' 2024-05-04 18:01:49 +02:00
backend fix 2024-05-02 15:59:45 -07:00
cypress fix: integration test 2024-05-02 14:20:53 -07:00
docs Revert "Merge Updates & Dockerfile improvements" (#3) 2024-04-02 11:28:04 +02:00
kubernetes fix(helm): remove trailing slash 2024-04-13 07:32:28 +02:00
src fix: drag and drop styling issue 2024-05-03 00:16:43 -07:00
static Merge remote-tracking branch 'upstream/main' 2024-05-04 18:01:49 +02:00
.dockerignore fix: default openai api value 2024-03-06 20:25:24 -08:00
.env.example fix 2024-04-30 20:04:30 +00:00
.eslintignore chat feature added 2023-10-08 15:38:42 -07:00
.eslintrc.cjs feat: add basic cypress test as initial work towards e2e tests 2024-04-27 14:10:10 +01:00
.gitattributes fixed Docker problem some users experienced 2024-02-13 12:46:21 +01:00
.gitignore feat: add basic cypress test as initial work towards e2e tests 2024-04-27 14:10:10 +01:00
.npmrc chat feature added 2023-10-08 15:38:42 -07:00
.prettierignore added kubernetes folder 2024-01-01 14:51:42 +01:00
.prettierrc chat feature added 2023-10-08 15:38:42 -07:00
CHANGELOG.md doc: changelog 2024-05-02 02:47:16 -07:00
Caddyfile.localhost feat: update .env.example and add Caddyfile 2023-10-22 12:26:55 -06:00
Dockerfile Update Dockerfile 2024-04-30 20:05:11 +00:00
INSTALLATION.md rename 2024-02-17 00:07:43 -08:00
LICENSE chore: revert license change 2023-11-14 13:32:59 -08:00
Makefile Chose between "docker-compose" and "docker compose" in Makefile 2024-04-19 19:30:25 +02:00
README.md Update README.md 2024-04-21 03:12:48 +00:00
TROUBLESHOOTING.md refac: OLLAMA_API_BASE_URL deprecated 2024-03-06 11:44:00 -08:00
bun.lockb first draft 2024-02-22 11:54:55 +01:00
confirm_remove.sh Chose between "docker-compose" and "docker compose" in confirm_remove.sh 2024-04-19 20:19:24 +02:00
cypress.config.ts feat: add basic cypress test as initial work towards e2e tests 2024-04-27 14:10:10 +01:00
demo.gif Revert "Merge Updates & Dockerfile improvements" (#3) 2024-04-02 11:28:04 +02:00
docker-compose.amdgpu.yaml Add variables 2024-04-05 23:46:20 -04:00
docker-compose.api.yaml fix: readme.md formatting 2023-12-31 15:10:33 -08:00
docker-compose.data.yaml chore: 🚨 lint and format 2024-01-03 14:33:57 -08:00
docker-compose.gpu.yaml fix: readme.md formatting 2023-12-31 15:10:33 -08:00
docker-compose.yaml Add Docker tag variables 2024-04-05 23:48:16 -04:00
i18next-parser.config.ts Revert "Merge Updates & Dockerfile improvements" (#3) 2024-04-02 11:28:04 +02:00
package-lock.json doc: changelog 2024-05-02 02:47:16 -07:00
package.json chore: format 2024-05-02 02:48:56 -07:00
postcss.config.js chore: npm run fmt 2023-10-21 22:47:30 -06:00
run-compose.sh fix: docker gpus option "all" support 2024-04-27 23:50:07 +03:00
run-ollama-docker.sh fix: run-ollama-docker.sh 2024-01-29 15:38:56 -08:00
run.sh Update run.sh 2024-02-19 11:43:53 -08:00
svelte.config.js Revert "Merge Updates & Dockerfile improvements" (#3) 2024-04-02 11:28:04 +02:00
tailwind.config.js Revert "Merge Updates & Dockerfile improvements" (#3) 2024-04-02 11:28:04 +02:00
tsconfig.json chat feature added 2023-10-08 15:38:42 -07:00
update_ollama_models.sh fix: update Makefile and rename script for open-webui integration 2024-02-24 07:51:27 +01:00
vite.config.ts Update vite.config.ts 2024-02-23 01:08:34 -08:00

README.md

Open WebUI (Formerly Ollama WebUI) 👋

GitHub stars GitHub forks GitHub watchers GitHub repo size GitHub language count GitHub top language GitHub last commit Hits Discord

Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs. For more information, be sure to check out our Open WebUI Documentation.

Open WebUI Demo

Features ⭐

  • 🖥️ Intuitive Interface: Our chat interface takes inspiration from ChatGPT, ensuring a user-friendly experience.

  • 📱 Responsive Design: Enjoy a seamless experience on both desktop and mobile devices.

  • ⚡ Swift Responsiveness: Enjoy fast and responsive performance.

  • 🚀 Effortless Setup: Install seamlessly using Docker or Kubernetes (kubectl, kustomize or helm) for a hassle-free experience.

  • 🌈 Theme Customization: Choose from a variety of themes to personalize your Open WebUI experience.

  • 💻 Code Syntax Highlighting: Enjoy enhanced code readability with our syntax highlighting feature.

  • ✒️🔢 Full Markdown and LaTeX Support: Elevate your LLM experience with comprehensive Markdown and LaTeX capabilities for enriched interaction.

  • 📚 Local RAG Integration: Dive into the future of chat interactions with the groundbreaking Retrieval Augmented Generation (RAG) support. This feature seamlessly integrates document interactions into your chat experience. You can load documents directly into the chat or add files to your document library, effortlessly accessing them using # command in the prompt. In its alpha phase, occasional issues may arise as we actively refine and enhance this feature to ensure optimal performance and reliability.

  • 🔍 RAG Embedding Support: Change the RAG embedding model directly in document settings, enhancing document processing. This feature supports Ollama and OpenAI models.

  • 🌐 Web Browsing Capability: Seamlessly integrate websites into your chat experience using the # command followed by the URL. This feature allows you to incorporate web content directly into your conversations, enhancing the richness and depth of your interactions.

  • 📜 Prompt Preset Support: Instantly access preset prompts using the / command in the chat input. Load predefined conversation starters effortlessly and expedite your interactions. Effortlessly import prompts through Open WebUI Community integration.

  • 👍👎 RLHF Annotation: Empower your messages by rating them with thumbs up and thumbs down, followed by the option to provide textual feedback, facilitating the creation of datasets for Reinforcement Learning from Human Feedback (RLHF). Utilize your messages to train or fine-tune models, all while ensuring the confidentiality of locally saved data.

  • 🏷️ Conversation Tagging: Effortlessly categorize and locate specific chats for quick reference and streamlined data collection.

  • 📥🗑️ Download/Delete Models: Easily download or remove models directly from the web UI.

  • 🔄 Update All Ollama Models: Easily update locally installed models all at once with a convenient button, streamlining model management.

  • ⬆️ GGUF File Model Creation: Effortlessly create Ollama models by uploading GGUF files directly from the web UI. Streamlined process with options to upload from your machine or download GGUF files from Hugging Face.

  • 🤖 Multiple Model Support: Seamlessly switch between different chat models for diverse interactions.

  • 🔄 Multi-Modal Support: Seamlessly engage with models that support multimodal interactions, including images (e.g., LLava).

  • 🧩 Modelfile Builder: Easily create Ollama modelfiles via the web UI. Create and add characters/agents, customize chat elements, and import modelfiles effortlessly through Open WebUI Community integration.

  • ⚙️ Many Models Conversations: Effortlessly engage with various models simultaneously, harnessing their unique strengths for optimal responses. Enhance your experience by leveraging a diverse set of models in parallel.

  • 💬 Collaborative Chat: Harness the collective intelligence of multiple models by seamlessly orchestrating group conversations. Use the @ command to specify the model, enabling dynamic and diverse dialogues within your chat interface. Immerse yourself in the collective intelligence woven into your chat environment.

  • 🗨️ Local Chat Sharing: Generate and share chat links seamlessly between users, enhancing collaboration and communication.

  • 🔄 Regeneration History Access: Easily revisit and explore your entire regeneration history.

  • 📜 Chat History: Effortlessly access and manage your conversation history.

  • 📬 Archive Chats: Effortlessly store away completed conversations with LLMs for future reference, maintaining a tidy and clutter-free chat interface while allowing for easy retrieval and reference.

  • 📤📥 Import/Export Chat History: Seamlessly move your chat data in and out of the platform.

  • 🗣️ Voice Input Support: Engage with your model through voice interactions; enjoy the convenience of talking to your model directly. Additionally, explore the option for sending voice input automatically after 3 seconds of silence for a streamlined experience.

  • 🔊 Configurable Text-to-Speech Endpoint: Customize your Text-to-Speech experience with configurable OpenAI endpoints.

  • ⚙️ Fine-Tuned Control with Advanced Parameters: Gain a deeper level of control by adjusting parameters such as temperature and defining your system prompts to tailor the conversation to your specific preferences and needs.

  • 🎨🤖 Image Generation Integration: Seamlessly incorporate image generation capabilities using options such as AUTOMATIC1111 API (local), ComfyUI (local), and DALL-E, enriching your chat experience with dynamic visual content.

  • 🤝 OpenAI API Integration: Effortlessly integrate OpenAI-compatible API for versatile conversations alongside Ollama models. Customize the API Base URL to link with LMStudio, Mistral, OpenRouter, and more.

  • ✨ Multiple OpenAI-Compatible API Support: Seamlessly integrate and customize various OpenAI-compatible APIs, enhancing the versatility of your chat interactions.

  • 🔑 API Key Generation Support: Generate secret keys to leverage Open WebUI with OpenAI libraries, simplifying integration and development.

  • 🔗 External Ollama Server Connection: Seamlessly link to an external Ollama server hosted on a different address by configuring the environment variable.

  • 🔀 Multiple Ollama Instance Load Balancing: Effortlessly distribute chat requests across multiple Ollama instances for enhanced performance and reliability.

  • 👥 Multi-User Management: Easily oversee and administer users via our intuitive admin panel, streamlining user management processes.

  • 🔗 Webhook Integration: Subscribe to new user sign-up events via webhook (compatible with Google Chat and Microsoft Teams), providing real-time notifications and automation capabilities.

  • 🛡️ Model Whitelisting: Admins can whitelist models for users with the 'user' role, enhancing security and access control.

  • 📧 Trusted Email Authentication: Authenticate using a trusted email header, adding an additional layer of security and authentication.

  • 🔐 Role-Based Access Control (RBAC): Ensure secure access with restricted permissions; only authorized individuals can access your Ollama, and exclusive model creation/pulling rights are reserved for administrators.

  • 🔒 Backend Reverse Proxy Support: Bolster security through direct communication between Open WebUI backend and Ollama. This key feature eliminates the need to expose Ollama over LAN. Requests made to the '/ollama/api' route from the web UI are seamlessly redirected to Ollama from the backend, enhancing overall system security.

  • 🌐🌍 Multilingual Support: Experience Open WebUI in your preferred language with our internationalization (i18n) support. Join us in expanding our supported languages! We're actively seeking contributors!

  • 🌟 Continuous Updates: We are committed to improving Open WebUI with regular updates and new features.

🔗 Also Check Out Open WebUI Community!

Don't forget to explore our sibling project, Open WebUI Community, where you can discover, download, and explore customized Modelfiles. Open WebUI Community offers a wide range of exciting possibilities for enhancing your chat interactions with Open WebUI! 🚀

How to Install 🚀

[!NOTE]
Please note that for certain Docker environments, additional configurations might be needed. If you encounter any connection issues, our detailed guide on Open WebUI Documentation is ready to assist you.

Quick Start with Docker 🐳

[!WARNING] When using Docker to install Open WebUI, make sure to include the -v open-webui:/app/backend/data in your Docker command. This step is crucial as it ensures your database is properly mounted and prevents any loss of data.

[!TIP]
If you wish to utilize Open WebUI with Ollama included or CUDA acceleration, we recommend utilizing our official images tagged with either :cuda or :ollama. To enable CUDA, you must install the Nvidia CUDA container toolkit on your Linux/WSL system.

If Ollama is on your computer, use this command:

docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

If Ollama is on a Different Server, use this command:

To connect to Ollama on another server, change the OLLAMA_BASE_URL to the server's URL:

docker run -d -p 3000:8080 -e OLLAMA_BASE_URL=https://example.com -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

After installation, you can access Open WebUI at http://localhost:3000. Enjoy! 😄

Open WebUI: Server Connection Error

If you're experiencing connection issues, it’s often due to the WebUI docker container not being able to reach the Ollama server at 127.0.0.1:11434 (host.docker.internal:11434) inside the container . Use the --network=host flag in your docker command to resolve this. Note that the port changes from 3000 to 8080, resulting in the link: http://localhost:8080.

Example Docker Command:

docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main

Other Installation Methods

We offer various installation alternatives, including non-Docker methods, Docker Compose, Kustomize, and Helm. Visit our Open WebUI Documentation or join our Discord community for comprehensive guidance.

Troubleshooting

Encountering connection issues? Our Open WebUI Documentation has got you covered. For further assistance and to join our vibrant community, visit the Open WebUI Discord.

Keeping Your Docker Installation Up-to-Date

In case you want to update your local Docker installation to the latest version, you can do it with Watchtower:

docker run --rm --volume /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once open-webui

In the last part of the command, replace open-webui with your container name if it is different.

Moving from Ollama WebUI to Open WebUI

Check our Migration Guide available in our Open WebUI Documentation.

What's Next? 🌟

Discover upcoming features on our roadmap in the Open WebUI Documentation.

Supporters ✨

A big shoutout to our amazing supporters who's helping to make this project possible! 🙏

Platinum Sponsors 🤍

  • We're looking for Sponsors!

Acknowledgments

Special thanks to Prof. Lawrence Kim and Prof. Nick Vincent for their invaluable support and guidance in shaping this project into a research endeavor. Grateful for your mentorship throughout the journey! 🙌

License 📜

This project is licensed under the MIT License - see the LICENSE file for details. 📄

Support 💬

If you have any questions, suggestions, or need assistance, please open an issue or join our Open WebUI Discord community to connect with us! 🤝

Star History

Star History Chart

Created by Timothy J. Baek - Let's make Open WebUI even more amazing together! 💪