Commit graph

529 commits

Author SHA1 Message Date
Doug Danat
c91a5d8b1f switch to using BeautifulSoup HTML loader so title is also captured 2024-03-25 11:26:18 +01:00
Doug Danat
784a6ec85e include html langchain loader for RAG 2024-03-25 09:50:53 +01:00
Timothy Jaeryang Baek
371dfc1143
Merge branch 'dev' into debug_print 2024-03-24 18:04:03 -05:00
Timothy Jaeryang Baek
a1faa307b1
Merge pull request #1272 from anuraagdjain/feat/cancel-model-download
feat: cancel model download
2024-03-24 18:00:57 -05:00
Timothy J. Baek
ff8a55a861 refac: rag api 2024-03-24 00:41:41 -07:00
Timothy J. Baek
7e0ea8f77d feat: RAG text ingestion(store) api 2024-03-24 00:40:27 -07:00
Timothy J. Baek
98624a406f feat: comfyui integration 2024-03-23 17:01:13 -07:00
Timothy J. Baek
862c96fcef feat: comfyui support 2024-03-23 15:38:59 -07:00
Timothy Jaeryang Baek
3e0d9ad74f
Merge branch 'dev' into feat/cancel-model-download 2024-03-23 15:16:06 -05:00
Timothy J. Baek
e008738f30 feat: cancel download from backend 2024-03-23 13:12:54 -07:00
Timothy J. Baek
5c1e3a460e fix: remove aiofiles dependency 2024-03-22 21:47:53 -07:00
Timothy Jaeryang Baek
848d2382bc
Merge pull request #1267 from Michelklingler/langfuse_dependency
Added langfuse dependency to the requierements.txt file.
2024-03-22 16:36:21 -05:00
Michel K
4140e1b84a Added langfuse dependency to the requierements.txt file. 2024-03-22 14:01:39 -04:00
Jannik Streidl
fdef2abdfb cuda fix 2024-03-22 12:48:48 +01:00
Jannik Streidl
fc4e762b05 ENV fix 2024-03-22 10:57:41 +01:00
Jannik Streidl
3f973fe77f i need coffee 2024-03-22 09:57:17 +01:00
Jannik Streidl
953d05428e grammar 2024-03-22 09:55:46 +01:00
Jannik Streidl
6dc4b748fb added comments 2024-03-22 09:50:01 +01:00
Jannik Streidl
fde0139bf7 All in one Dockerfile for including Ollama 2024-03-22 09:31:35 +01:00
Timothy J. Baek
92cc87d908 fix: ollama upload url 2024-03-22 00:58:38 -07:00
Timothy J. Baek
9e37d6edcc refac: gguf upload ui 2024-03-22 00:55:59 -07:00
Timothy J. Baek
77ec296ac3 chore: print removed 2024-03-22 00:11:17 -07:00
Timothy J. Baek
bc80f1438c fix: ollama gguf upload 2024-03-22 00:10:55 -07:00
Timothy J. Baek
af4caec4f5 refac: ollama gguf upload 2024-03-21 23:45:00 -07:00
Self Denial
f74f2ea765 Merge conflicts 2024-03-21 00:14:13 -06:00
Timothy Jaeryang Baek
5a90e90c0b
Merge pull request #1241 from 7a6ac0/duplicate_def
fix: delete duplicate function
2024-03-20 22:01:13 -05:00
Timothy J. Baek
8e52ba8b91 refac: auth required for litellm in dev 2024-03-20 19:33:27 -07:00
Timothy J. Baek
ed0d4b5a2a chore: comment clean up 2024-03-20 19:32:25 -07:00
tabaco.wang
a1412d0b55 fix: delete duplicate function 2024-03-21 10:31:25 +08:00
Timothy J. Baek
93c90dc186 feat: litellm model filter support 2024-03-20 19:28:33 -07:00
Timothy J. Baek
fa65be2ad2 refac: post webhook 2024-03-20 18:47:13 -07:00
Timothy J. Baek
2c6e2d5e8a feat: webhook backend 2024-03-20 18:35:02 -07:00
Self Denial
e6dd0bfbe0 Migrate to python logging module with env var control. 2024-03-20 17:11:36 -06:00
Jannik Streidl
1f6739337b docker improvements & changed universal device type env for different models used 2024-03-20 08:44:09 +01:00
Timothy Jaeryang Baek
16fe0ee167
Merge pull request #1151 from changchiyou/feat/custom_default_user_permissions_chat_deletion
Feat/custom default user permissions chat deletion
2024-03-19 16:23:23 -05:00
Timothy J. Baek
87344adf29 refac 2024-03-19 14:21:46 -07:00
Timothy J. Baek
349fd0c87d refac: config.json 2024-03-19 14:03:46 -07:00
Timothy J. Baek
e86db74333 refac: stream default value 2024-03-18 18:14:05 -07:00
Timothy J. Baek
b188143f01 fix: openai proxy issue 2024-03-18 11:04:22 -07:00
Timothy J. Baek
ec9895a14a fix: openai proxy issue 2024-03-18 11:02:09 -07:00
Timothy J. Baek
1bfcd801b7 fix: multiple openai issue 2024-03-18 01:11:48 -07:00
Timothy J. Baek
1e03871748 fix: openai issue 2024-03-16 03:25:20 -07:00
Timothy J. Baek
ed964260ba fix: openai urls issue 2024-03-16 02:45:24 -07:00
Timothy J. Baek
91efd6cb63 fix: file upload encoding issue 2024-03-15 23:52:37 -07:00
Timothy J. Baek
072b499a50 fix: backslash rag content issue 2024-03-15 13:34:52 -07:00
Timothy Jaeryang Baek
7cef008b44
Merge pull request #1163 from joequant/main
fix typo in uploading blob to ollama
2024-03-14 15:48:49 -05:00
Joseph C Wang
9ee0feae32 fix typo in uploading blob to ollama 2024-03-14 17:17:52 +08:00
changchiyou
c6e14ce327
refactor: restrict the scope of USER_PERMISSIONS_CHAT_DELETION
it can easily confuse people before becuase when people accidentally set `env.USER_PERMISSIONS_CHAT_DELETION` to `true/yes/Yes`, `USER_PERMISSIONS["chat"]["deletion"]` would become `False`, which is unexpectedly and hard to notice.
2024-03-14 00:01:46 +08:00
changchiyou
04e3b168a6
config: allow custom default user permissions - chat deletion
Allow Chat Deletion
2024-03-13 23:17:22 +08:00
Timothy J. Baek
7f78e58488 refac: image generation error handling 2024-03-12 13:35:30 -07:00
Timothy J. Baek
26a187f5ac refac: print removed 2024-03-12 00:26:53 -07:00
Timothy J. Baek
be3ab88c88 fix: error handling 2024-03-12 00:26:14 -07:00
Timothy J. Baek
e3fc97241d fix: env var migration issue 2024-03-10 19:26:06 -07:00
Timothy J. Baek
b4c770d74b fix: disable openai model by default 2024-03-10 19:00:43 -07:00
Timothy J. Baek
8df6b137cb fix: rag 2024-03-10 18:40:50 -07:00
Timothy J. Baek
64afde6c0e refac: config versioning 2024-03-10 14:15:32 -07:00
Timothy J. Baek
98948814fd feat: toggle pdf ocr 2024-03-10 13:32:34 -07:00
Timothy J. Baek
96ada23272 Update requirements.txt 2024-03-10 00:00:16 -08:00
Timothy J. Baek
a02ac67b5c Update requirements.txt 2024-03-09 23:59:17 -08:00
Timothy J. Baek
350489e600 fix: requirements.txt 2024-03-09 23:49:07 -08:00
Timothy J. Baek
a4ca1fc5c4 feat: model filter list env var 2024-03-09 21:47:01 -08:00
Timothy Jaeryang Baek
bcabd3df84
Merge pull request #1117 from open-webui/model-whitelist
feat: model filter (whitelist)
2024-03-10 00:30:43 -05:00
Timothy J. Baek
81daf4ceb9 feat: model filter frontend integration 2024-03-09 21:29:04 -08:00
Timothy J. Baek
b550e23bf6 feat: model filter backend 2024-03-09 21:19:20 -08:00
Timothy J. Baek
1a93021cc4 fix: log modified messages 2024-03-09 20:12:32 -08:00
Timothy J. Baek
784ee6f521 fix: error handling 2024-03-08 23:21:00 -08:00
Timothy J. Baek
d936353da0 fix: message type edge case 2024-03-08 23:19:20 -08:00
Timothy J. Baek
9f58ed5afa fix 2024-03-08 22:52:42 -08:00
Timothy J. Baek
dfcc314283 fix: only edit body with whitelisted paths 2024-03-08 22:51:42 -08:00
Timothy J. Baek
6c58bb59be feat: rag docs as payload field 2024-03-08 22:43:06 -08:00
Timothy J. Baek
c49491e516 refac: rag to backend 2024-03-08 22:34:47 -08:00
Timothy J. Baek
6ba62cf25d fix: dalle3 issue 2024-03-08 19:54:47 -08:00
Timothy Jaeryang Baek
19700e9074
Merge pull request #1109 from ther0bster/fix-openai-env-var-parsing
fix: parsing of OPENAI_API_BASE_URLS env var
2024-03-08 22:31:57 -05:00
Timothy J. Baek
7e5e2c42c9 refac: rag routes 2024-03-08 19:26:39 -08:00
Roberto Gudelj
9235864f56 fix: parsing of OPENAI_API_BASE_URLS env var 2024-03-09 04:11:39 +01:00
Timothy J. Baek
0221acd163 feat: dall-e integration 2024-03-08 17:38:10 -08:00
Timothy J. Baek
2b84af878a refac: litellm 2024-03-08 13:33:56 -08:00
Timothy J. Baek
df49e4e1cc fix: default openai api value 2024-03-06 20:25:24 -08:00
Timothy J. Baek
34c7b6783c fix: ocr issue 2024-03-06 18:49:35 -08:00
Timothy J. Baek
53adc6a0ca fix: rag issue 2024-03-06 18:37:40 -08:00
Timothy J. Baek
b88c64f80e fix: ocr issue 2024-03-06 17:54:42 -08:00
Timothy Jaeryang Baek
dc6e91a23d
Merge pull request #1074 from open-webui/main
dev
2024-03-06 20:07:37 -05:00
Timothy J. Baek
bb98c10abb revert: ocr feature 2024-03-06 17:04:40 -08:00
Timothy J. Baek
c255cba198 feat: multiple openai apis 2024-03-06 16:13:25 -08:00
Timothy J. Baek
51d509bafb Update config.py 2024-03-06 13:18:17 -08:00
Timothy J. Baek
0142c2de43 refac: semicolon as delimiter 2024-03-06 12:42:14 -08:00
Timothy J. Baek
c9173b71b6 chore: comment rename 2024-03-06 11:51:51 -08:00
Timothy J. Baek
f741adc6c9 refac: OLLAMA_API_BASE_URL deprecated 2024-03-06 11:44:00 -08:00
Timothy Jaeryang Baek
8fb5f54751
Merge pull request #1050 from jannikstdl/rag-pdf-ocr
feat: added ocr functionality to the pdf loader
2024-03-06 00:45:33 -05:00
Jannik Streidl
089a63e0c6 feat: added ocr functionality to the pdf loader 2024-03-05 22:25:25 +01:00
Timothy J. Baek
124020f824 chore: added print url for debugging 2024-03-05 02:19:25 -08:00
Timothy J. Baek
fbdac832bb feat: multiple ollama model management 2024-03-05 02:12:55 -08:00
Timothy J. Baek
8626ae60dd chore: old_main removed 2024-03-05 01:43:33 -08:00
Timothy J. Baek
8d34324d12 feat: cancel request
Resolves #1006
2024-03-05 01:41:22 -08:00
Timothy J. Baek
b2dd2f191d refac: comment 2024-03-05 01:21:50 -08:00
Timothy J. Baek
8fd7bc342d refac: error message 2024-03-05 01:07:59 -08:00
Timothy J. Baek
f04d60b6d9 feat: multiple ollama support 2024-03-05 00:59:35 -08:00
Timothy Jaeryang Baek
32495256fa
Merge pull request #1029 from fbirlik/patch-ragrecreate
recreate rag collection instead of falling back to stale version
2024-03-04 16:21:54 -05:00
Firat Birlik
6782e95c75 recreate rag collection is now optional and only used for web requests 2024-03-04 10:00:06 -06:00
Timothy J. Baek
20263f742a refac: confusing ollama proxy route path 2024-03-03 19:55:32 -08:00
Firat Birlik
5d4ff85228 recreate rag collection instead of falling back to stale version 2024-03-03 21:25:00 -06:00
Firat Birlik
05221ea135 add fake_useragent to get a realistic header for rag/web requests 2024-03-03 13:58:51 -06:00
Timothy J. Baek
47a05a47b4 feat: add rag top k value setting 2024-03-02 18:56:57 -08:00
Timothy J. Baek
901e7a33fa feat: chat playground backend integration 2024-03-02 18:16:02 -08:00
Timothy J. Baek
2379e94cbf feat: text completion playground 2024-03-02 03:01:44 -08:00
Timothy J. Baek
edb63c2280 feat: download db from admin settings 2024-03-02 00:33:20 -08:00
Timothy J. Baek
6d854125cc refac: ollama.db renamed to webui.db 2024-03-02 00:19:24 -08:00
Timothy J. Baek
74809e7330 fix: user chat delete loophole 2024-03-02 00:07:50 -08:00
Han Cen
a12b5ffab3
Fix enable signup env 2024-03-02 15:38:14 +08:00
Timothy J. Baek
59ae5b6d34 fix: openai filtering 2024-02-27 20:08:57 -08:00
Timothy J. Baek
781be2779b refac: unnecessary max_token value removed 2024-02-27 20:02:23 -08:00
Sakkus
bbeaa92904 Fix OpenAI integration:
from docker on mac get errors since num_ctx not recognized;
remove num_ctx from, and max_tokens to, body in API calls.
2024-02-26 12:25:08 +00:00
Timothy J. Baek
1d937ec2f2 fix: cleanup unused tags 2024-02-25 13:03:26 -08:00
Timothy J. Baek
759883a4c8 feat: check for updates 2024-02-25 11:55:15 -08:00
Timothy J. Baek
6bfe2a6306 feat: latest release check api 2024-02-25 11:26:58 -08:00
Timothy J. Baek
c8631660c7 Update requirements.txt 2024-02-25 00:58:58 -08:00
Timothy J. Baek
d0c0d0d2b4 fix: litellm config issue 2024-02-24 22:35:11 -08:00
Timothy J. Baek
366679ff7c fix: 'dict' object issue 2024-02-24 22:10:43 -08:00
Timothy Jaeryang Baek
271e5bf44d
Merge branch 'dev' into feature/img-gen-steps-setting 2024-02-24 21:09:06 -05:00
Timothy J. Baek
393531c9b0 fix 2024-02-24 18:08:35 -08:00
Timothy J. Baek
ec6f53e298 feat: litellm proxy frontend integration 2024-02-24 17:56:53 -08:00
Timothy J. Baek
e15e015db1 fix: images 2024-02-24 15:48:14 -08:00
Timothy J. Baek
32da2aa511 Update config.py 2024-02-24 13:11:56 -08:00
Justin Firth
3fa79e59bf Allow configuration of steps, default to a1111 default 2024-02-24 10:44:08 -05:00
Timothy J. Baek
a74d47b6fc Update requirements.txt 2024-02-24 01:27:44 -08:00
Timothy J. Baek
bfba72d486 fix: pip dependency 2024-02-24 01:19:44 -08:00
Timothy J. Baek
43f9a827d3 fix: gitignore 2024-02-24 00:29:03 -08:00
Timothy J. Baek
14dd0d11fb feat: litellm yaml 2024-02-24 00:21:53 -08:00
Timothy J. Baek
b5bd07a06a feat: secure litellm api 2024-02-23 22:44:56 -08:00
Timothy Jaeryang Baek
ee22e641ff
Merge branch 'main' into litellm 2024-02-24 01:10:04 -05:00
Timothy J. Baek
d1f170dc77 fix: error handling 2024-02-23 17:36:38 -08:00
Timothy J. Baek
decba05c7a Update config.py 2024-02-23 17:24:46 -08:00
Timothy J. Baek
62f67bed29 feat: sponsor custom name support 2024-02-23 17:12:19 -08:00
Timothy Jaeryang Baek
a974d736d2
Merge pull request #866 from asedmammad/fix-rag-scan-unsupported-mime
fix: RAG scan unsupported mime type
2024-02-23 14:03:24 -05:00
Ased Mammad
b473ad574f fix: RAG scan unsupported mimetype
This fixes an issue with RAG that stops loading documents as soon
as it reaches a file with unsupported mimetype.
2024-02-23 14:27:31 +03:30
David Girón
214881451d
allow custom default user role 2024-02-23 11:03:06 +01:00
Timothy Jaeryang Baek
8fac9de269
Merge branch 'main' into release-notes-modal 2024-02-23 04:07:16 -05:00
Timothy J. Baek
a84070c6d3 refac: changelog api 2024-02-23 00:36:53 -08:00
Timothy J. Baek
9f950aea9c feat: changelog.md 2024-02-23 00:30:26 -08:00
Timothy J. Baek
7ec4c07bf9 feat: image size param 2024-02-22 19:32:36 -08:00
Timothy J. Baek
de0084c8df feat: litellm integration 2024-02-22 03:22:23 -08:00
Timothy J. Baek
dc705c4984 refac: settings 2024-02-21 19:06:27 -08:00
Timothy J. Baek
797ed9ac7f feat: allow enabling after url is provided 2024-02-21 18:57:53 -08:00
Timothy J. Baek
cc50cc10e6 feat: sd frontend integration 2024-02-21 18:36:40 -08:00
Timothy J. Baek
733e963c44 feat: sd backend integration 2024-02-21 18:12:01 -08:00
Timothy J. Baek
7a730c3f0f refac: versioning using package 2024-02-21 17:10:27 -08:00
Timothy Jaeryang Baek
6d6ab6459d
Merge pull request #815 from open-webui/auth
feat: jwt utils
2024-02-19 23:45:15 -05:00
Timothy J. Baek
275523e32e feat: jwt utils 2024-02-19 20:44:00 -08:00
Timothy J. Baek
5da73824ba Update config.json 2024-02-19 19:46:46 -08:00
Timothy J. Baek
3d10f21b3b feat: include default config.json 2024-02-19 19:28:34 -08:00
Timothy J. Baek
daa989b7dc feat: validate type 2024-02-19 19:09:09 -08:00
Timothy J. Baek
d58de061fa feat: config.json support 2024-02-19 18:54:22 -08:00
Timothy J. Baek
7c127c35fc feat: dynamic embedding model load 2024-02-19 11:05:45 -08:00
Timothy J. Baek
ab104d5905 refac 2024-02-19 10:56:50 -08:00
Jannik Streidl
acf999013b storing vectordb in project cache folder + device types 2024-02-19 07:51:17 +01:00
Timothy J. Baek
0cb0358485 refac: more descriptive var names 2024-02-18 11:16:10 -08:00
Jannik S
4b88e7e44f
Merge branch 'main' into choose-embedding-model 2024-02-18 09:20:54 +01:00
Jannik Streidl
bc3dd34d8b collection query fix 2024-02-18 09:17:43 +01:00
Timothy J. Baek
07b451995e feat: reset rag template 2024-02-17 22:49:18 -08:00
Timothy J. Baek
5270efa9e5 feat: editable rag template 2024-02-17 22:41:03 -08:00
Timothy J. Baek
ccf08fb91e feat: editable chunk params 2024-02-17 22:29:52 -08:00
Timothy J. Baek
a94e4161f7 fix: file content type issue 2024-02-17 21:31:46 -08:00
Timothy J. Baek
e07001e5f6 feat: rag folder scan support 2024-02-17 21:06:08 -08:00
Timothy J. Baek
d1e5274fc9 Update start_windows.bat 2024-02-17 11:25:11 -08:00
Timothy J. Baek
22d2c13713 Update start_windows.bat 2024-02-17 10:43:50 -08:00
Timothy J. Baek
bd9e5c013f feat: start command for windows 2024-02-17 10:41:17 -08:00
Jannik Streidl
1846c1e80d choose embedding model when using docker 2024-02-17 19:38:29 +01:00
Timothy J. Baek
90bcd1644a rename to open-webui 2024-02-16 23:30:38 -08:00
Timothy Jaeryang Baek
1def55cf09
Merge pull request #725 from jnkstr/no-internet-whisper
fix: no internet connection for whisper if you use docker
2024-02-15 02:44:31 -05:00
Timothy J. Baek
63e6f39b31 refac 2024-02-14 23:32:54 -08:00
Timothy J. Baek
434e2c00e9 fix: user display limit 2024-02-14 13:24:40 -08:00
Timothy J. Baek
43b05fa7dd chore: version update 2024-02-14 01:19:39 -08:00
Timothy J. Baek
511e939b5d feat: admin settings 2024-02-14 01:17:43 -08:00
Jannik Streidl
8ab0338e71 no internet connection for whisper if you use docker 2024-02-13 15:11:53 +01:00
Timothy J. Baek
2ef4fc1215 fix: strip transcription text 2024-02-11 02:17:24 -08:00
Timothy J. Baek
98496a7055 feat: update default whisper model 2024-02-11 02:15:54 -08:00
Timothy J. Baek
a5b9bbf10b feat: whisper support 2024-02-11 00:17:50 -08:00
Timothy J. Baek
3af8d16e6a fix: admin issue 2024-02-10 17:54:33 -08:00
Timothy Jaeryang Baek
9f3346a6ec
Merge pull request #682 from explorigin/simplify-endpoint-code
Simplify endpoint role checking
2024-02-09 14:26:56 -08:00
Tim Farrell
08e8e922fd Endpoint role-checking was redundantly applied but FastAPI provides a nice abstraction mechanic...so I applied it. There should be no logical changes in this code; only simpler, cleaner ways for doing the same thing. 2024-02-08 18:05:01 -06:00
Kyle McLaren
d4fec48d9c
get ENABLE_SIGNUP from env 2024-02-06 20:58:07 +02:00
Timothy J. Baek
519e27978f refac 2024-02-05 22:58:02 -08:00
Timothy J. Baek
1b040143eb feat: cache request body 2024-02-05 22:57:24 -08:00
Timothy J. Baek
0b8df52c97 feat: openai tts support 2024-02-05 22:51:08 -08:00
Timothy J. Baek
8468c18059 Update .gitignore 2024-02-04 21:29:04 -08:00
Timothy J. Baek
7c2f297c84 feat: export all chats from db
admin only
2024-02-04 01:07:18 -08:00
Timothy J. Baek
f73a1fc4ea chore: version update 2024-02-03 17:42:08 -08:00
Timothy Jaeryang Baek
323ec3787e
Merge pull request #624 from explorigin/session-security
Improve Session Security
2024-02-03 17:41:31 -08:00
Timothy Jaeryang Baek
1f02940bbd
Merge pull request #617 from ollama-webui/doc-collection
feat: document collection
2024-02-03 17:28:11 -08:00
Timothy J. Baek
683650ec00 feat: collection rag integration 2024-02-03 15:57:06 -08:00
Timothy J. Baek
00803c92f2 feat: doc tagging 2024-02-03 14:44:49 -08:00
Tim Farrell
8298cefd62 Fix bash condition formatting 2024-02-02 09:02:48 -06:00
Tim Farrell
1031638d82 Maintain backward compatibility with WEBUI_JWT_SECRET_KEY for the time being 2024-02-02 09:02:35 -06:00
Tim Farrell
e2d481d99a Move the random secret generation to start.sh.
This way the random secret is created on first run instead of docker build. We don't really want all standard imaages to share a password anymore than we want a static password.
2024-02-02 09:02:23 -06:00
Tim Farrell
44799e2018 Remove some extraneous imports 2024-02-02 09:02:07 -06:00
Tim Farrell
4fceb404bd Call jwt.decode with the expected algorithms 2024-02-02 09:01:57 -06:00
Tim Farrell
e15dbdc46a Pass the instance we're using. 2024-02-02 09:01:34 -06:00
Tim Farrell
8c37edd027 Even though "User.email" is enforced as unique at signup, it is not a unique field in the database. Let's use "User.id" instead. This also makes it more difficult to do a session stealing attack. 2024-02-02 09:01:06 -06:00
Tim Farrell
2c1dacb9b6 We should verify signatures to make the whole session secret meaningful. 2024-02-02 09:00:31 -06:00
Tim Farrell
03a7e35967 Default docker installations should generate a random key instead of using a static secret that everyone can see. 2024-02-02 08:59:46 -06:00