Commit graph

625 commits

Author SHA1 Message Date
Timothy J. Baek
ff8a55a861 refac: rag api 2024-03-24 00:41:41 -07:00
Timothy J. Baek
7e0ea8f77d feat: RAG text ingestion(store) api 2024-03-24 00:40:27 -07:00
Timothy J. Baek
98624a406f feat: comfyui integration 2024-03-23 17:01:13 -07:00
Timothy J. Baek
862c96fcef feat: comfyui support 2024-03-23 15:38:59 -07:00
Timothy Jaeryang Baek
3e0d9ad74f
Merge branch 'dev' into feat/cancel-model-download 2024-03-23 15:16:06 -05:00
Timothy J. Baek
e008738f30 feat: cancel download from backend 2024-03-23 13:12:54 -07:00
Timothy J. Baek
5c1e3a460e fix: remove aiofiles dependency 2024-03-22 21:47:53 -07:00
Timothy Jaeryang Baek
848d2382bc
Merge pull request #1267 from Michelklingler/langfuse_dependency
Added langfuse dependency to the requierements.txt file.
2024-03-22 16:36:21 -05:00
Michel K
4140e1b84a Added langfuse dependency to the requierements.txt file. 2024-03-22 14:01:39 -04:00
Jannik Streidl
fdef2abdfb cuda fix 2024-03-22 12:48:48 +01:00
Jannik Streidl
fc4e762b05 ENV fix 2024-03-22 10:57:41 +01:00
Jannik Streidl
3f973fe77f i need coffee 2024-03-22 09:57:17 +01:00
Jannik Streidl
953d05428e grammar 2024-03-22 09:55:46 +01:00
Jannik Streidl
6dc4b748fb added comments 2024-03-22 09:50:01 +01:00
Jannik Streidl
fde0139bf7 All in one Dockerfile for including Ollama 2024-03-22 09:31:35 +01:00
Timothy J. Baek
92cc87d908 fix: ollama upload url 2024-03-22 00:58:38 -07:00
Timothy J. Baek
9e37d6edcc refac: gguf upload ui 2024-03-22 00:55:59 -07:00
Timothy J. Baek
77ec296ac3 chore: print removed 2024-03-22 00:11:17 -07:00
Timothy J. Baek
bc80f1438c fix: ollama gguf upload 2024-03-22 00:10:55 -07:00
Timothy J. Baek
af4caec4f5 refac: ollama gguf upload 2024-03-21 23:45:00 -07:00
Self Denial
f74f2ea765 Merge conflicts 2024-03-21 00:14:13 -06:00
Timothy Jaeryang Baek
5a90e90c0b
Merge pull request #1241 from 7a6ac0/duplicate_def
fix: delete duplicate function
2024-03-20 22:01:13 -05:00
Timothy J. Baek
8e52ba8b91 refac: auth required for litellm in dev 2024-03-20 19:33:27 -07:00
Timothy J. Baek
ed0d4b5a2a chore: comment clean up 2024-03-20 19:32:25 -07:00
tabaco.wang
a1412d0b55 fix: delete duplicate function 2024-03-21 10:31:25 +08:00
Timothy J. Baek
93c90dc186 feat: litellm model filter support 2024-03-20 19:28:33 -07:00
Timothy J. Baek
fa65be2ad2 refac: post webhook 2024-03-20 18:47:13 -07:00
Timothy J. Baek
2c6e2d5e8a feat: webhook backend 2024-03-20 18:35:02 -07:00
Self Denial
e6dd0bfbe0 Migrate to python logging module with env var control. 2024-03-20 17:11:36 -06:00
Jannik Streidl
1f6739337b docker improvements & changed universal device type env for different models used 2024-03-20 08:44:09 +01:00
Timothy Jaeryang Baek
16fe0ee167
Merge pull request #1151 from changchiyou/feat/custom_default_user_permissions_chat_deletion
Feat/custom default user permissions chat deletion
2024-03-19 16:23:23 -05:00
Timothy J. Baek
87344adf29 refac 2024-03-19 14:21:46 -07:00
Timothy J. Baek
349fd0c87d refac: config.json 2024-03-19 14:03:46 -07:00
Timothy J. Baek
e86db74333 refac: stream default value 2024-03-18 18:14:05 -07:00
Timothy J. Baek
b188143f01 fix: openai proxy issue 2024-03-18 11:04:22 -07:00
Timothy J. Baek
ec9895a14a fix: openai proxy issue 2024-03-18 11:02:09 -07:00
Timothy J. Baek
1bfcd801b7 fix: multiple openai issue 2024-03-18 01:11:48 -07:00
Timothy J. Baek
1e03871748 fix: openai issue 2024-03-16 03:25:20 -07:00
Timothy J. Baek
ed964260ba fix: openai urls issue 2024-03-16 02:45:24 -07:00
Timothy J. Baek
91efd6cb63 fix: file upload encoding issue 2024-03-15 23:52:37 -07:00
Timothy J. Baek
072b499a50 fix: backslash rag content issue 2024-03-15 13:34:52 -07:00
Timothy Jaeryang Baek
7cef008b44
Merge pull request #1163 from joequant/main
fix typo in uploading blob to ollama
2024-03-14 15:48:49 -05:00
Joseph C Wang
9ee0feae32 fix typo in uploading blob to ollama 2024-03-14 17:17:52 +08:00
changchiyou
c6e14ce327
refactor: restrict the scope of USER_PERMISSIONS_CHAT_DELETION
it can easily confuse people before becuase when people accidentally set `env.USER_PERMISSIONS_CHAT_DELETION` to `true/yes/Yes`, `USER_PERMISSIONS["chat"]["deletion"]` would become `False`, which is unexpectedly and hard to notice.
2024-03-14 00:01:46 +08:00
changchiyou
04e3b168a6
config: allow custom default user permissions - chat deletion
Allow Chat Deletion
2024-03-13 23:17:22 +08:00
Timothy J. Baek
7f78e58488 refac: image generation error handling 2024-03-12 13:35:30 -07:00
Timothy J. Baek
26a187f5ac refac: print removed 2024-03-12 00:26:53 -07:00
Timothy J. Baek
be3ab88c88 fix: error handling 2024-03-12 00:26:14 -07:00
Timothy J. Baek
e3fc97241d fix: env var migration issue 2024-03-10 19:26:06 -07:00
Timothy J. Baek
b4c770d74b fix: disable openai model by default 2024-03-10 19:00:43 -07:00
Timothy J. Baek
8df6b137cb fix: rag 2024-03-10 18:40:50 -07:00
Timothy J. Baek
64afde6c0e refac: config versioning 2024-03-10 14:15:32 -07:00
Timothy J. Baek
98948814fd feat: toggle pdf ocr 2024-03-10 13:32:34 -07:00
Timothy J. Baek
96ada23272 Update requirements.txt 2024-03-10 00:00:16 -08:00
Timothy J. Baek
a02ac67b5c Update requirements.txt 2024-03-09 23:59:17 -08:00
Timothy J. Baek
350489e600 fix: requirements.txt 2024-03-09 23:49:07 -08:00
Timothy J. Baek
a4ca1fc5c4 feat: model filter list env var 2024-03-09 21:47:01 -08:00
Timothy Jaeryang Baek
bcabd3df84
Merge pull request #1117 from open-webui/model-whitelist
feat: model filter (whitelist)
2024-03-10 00:30:43 -05:00
Timothy J. Baek
81daf4ceb9 feat: model filter frontend integration 2024-03-09 21:29:04 -08:00
Timothy J. Baek
b550e23bf6 feat: model filter backend 2024-03-09 21:19:20 -08:00
Timothy J. Baek
1a93021cc4 fix: log modified messages 2024-03-09 20:12:32 -08:00
Timothy J. Baek
784ee6f521 fix: error handling 2024-03-08 23:21:00 -08:00
Timothy J. Baek
d936353da0 fix: message type edge case 2024-03-08 23:19:20 -08:00
Timothy J. Baek
9f58ed5afa fix 2024-03-08 22:52:42 -08:00
Timothy J. Baek
dfcc314283 fix: only edit body with whitelisted paths 2024-03-08 22:51:42 -08:00
Timothy J. Baek
6c58bb59be feat: rag docs as payload field 2024-03-08 22:43:06 -08:00
Timothy J. Baek
c49491e516 refac: rag to backend 2024-03-08 22:34:47 -08:00
Timothy J. Baek
6ba62cf25d fix: dalle3 issue 2024-03-08 19:54:47 -08:00
Timothy Jaeryang Baek
19700e9074
Merge pull request #1109 from ther0bster/fix-openai-env-var-parsing
fix: parsing of OPENAI_API_BASE_URLS env var
2024-03-08 22:31:57 -05:00
Timothy J. Baek
7e5e2c42c9 refac: rag routes 2024-03-08 19:26:39 -08:00
Roberto Gudelj
9235864f56 fix: parsing of OPENAI_API_BASE_URLS env var 2024-03-09 04:11:39 +01:00
Timothy J. Baek
0221acd163 feat: dall-e integration 2024-03-08 17:38:10 -08:00
Timothy J. Baek
2b84af878a refac: litellm 2024-03-08 13:33:56 -08:00
Timothy J. Baek
df49e4e1cc fix: default openai api value 2024-03-06 20:25:24 -08:00
Timothy J. Baek
34c7b6783c fix: ocr issue 2024-03-06 18:49:35 -08:00
Timothy J. Baek
53adc6a0ca fix: rag issue 2024-03-06 18:37:40 -08:00
Timothy J. Baek
b88c64f80e fix: ocr issue 2024-03-06 17:54:42 -08:00
Timothy Jaeryang Baek
dc6e91a23d
Merge pull request #1074 from open-webui/main
dev
2024-03-06 20:07:37 -05:00
Timothy J. Baek
bb98c10abb revert: ocr feature 2024-03-06 17:04:40 -08:00
Timothy J. Baek
c255cba198 feat: multiple openai apis 2024-03-06 16:13:25 -08:00
Timothy J. Baek
51d509bafb Update config.py 2024-03-06 13:18:17 -08:00
Timothy J. Baek
0142c2de43 refac: semicolon as delimiter 2024-03-06 12:42:14 -08:00
Timothy J. Baek
c9173b71b6 chore: comment rename 2024-03-06 11:51:51 -08:00
Timothy J. Baek
f741adc6c9 refac: OLLAMA_API_BASE_URL deprecated 2024-03-06 11:44:00 -08:00
Timothy Jaeryang Baek
8fb5f54751
Merge pull request #1050 from jannikstdl/rag-pdf-ocr
feat: added ocr functionality to the pdf loader
2024-03-06 00:45:33 -05:00
Jannik Streidl
089a63e0c6 feat: added ocr functionality to the pdf loader 2024-03-05 22:25:25 +01:00
Timothy J. Baek
124020f824 chore: added print url for debugging 2024-03-05 02:19:25 -08:00
Timothy J. Baek
fbdac832bb feat: multiple ollama model management 2024-03-05 02:12:55 -08:00
Timothy J. Baek
8626ae60dd chore: old_main removed 2024-03-05 01:43:33 -08:00
Timothy J. Baek
8d34324d12 feat: cancel request
Resolves #1006
2024-03-05 01:41:22 -08:00
Timothy J. Baek
b2dd2f191d refac: comment 2024-03-05 01:21:50 -08:00
Timothy J. Baek
8fd7bc342d refac: error message 2024-03-05 01:07:59 -08:00
Timothy J. Baek
f04d60b6d9 feat: multiple ollama support 2024-03-05 00:59:35 -08:00
Timothy Jaeryang Baek
32495256fa
Merge pull request #1029 from fbirlik/patch-ragrecreate
recreate rag collection instead of falling back to stale version
2024-03-04 16:21:54 -05:00
Firat Birlik
6782e95c75 recreate rag collection is now optional and only used for web requests 2024-03-04 10:00:06 -06:00
Timothy J. Baek
20263f742a refac: confusing ollama proxy route path 2024-03-03 19:55:32 -08:00
Firat Birlik
5d4ff85228 recreate rag collection instead of falling back to stale version 2024-03-03 21:25:00 -06:00
Firat Birlik
05221ea135 add fake_useragent to get a realistic header for rag/web requests 2024-03-03 13:58:51 -06:00
Timothy J. Baek
47a05a47b4 feat: add rag top k value setting 2024-03-02 18:56:57 -08:00
Timothy J. Baek
901e7a33fa feat: chat playground backend integration 2024-03-02 18:16:02 -08:00
Timothy J. Baek
2379e94cbf feat: text completion playground 2024-03-02 03:01:44 -08:00
Timothy J. Baek
edb63c2280 feat: download db from admin settings 2024-03-02 00:33:20 -08:00
Timothy J. Baek
6d854125cc refac: ollama.db renamed to webui.db 2024-03-02 00:19:24 -08:00
Timothy J. Baek
74809e7330 fix: user chat delete loophole 2024-03-02 00:07:50 -08:00
Han Cen
a12b5ffab3
Fix enable signup env 2024-03-02 15:38:14 +08:00
Timothy J. Baek
59ae5b6d34 fix: openai filtering 2024-02-27 20:08:57 -08:00
Timothy J. Baek
781be2779b refac: unnecessary max_token value removed 2024-02-27 20:02:23 -08:00
Sakkus
bbeaa92904 Fix OpenAI integration:
from docker on mac get errors since num_ctx not recognized;
remove num_ctx from, and max_tokens to, body in API calls.
2024-02-26 12:25:08 +00:00
Timothy J. Baek
1d937ec2f2 fix: cleanup unused tags 2024-02-25 13:03:26 -08:00
Timothy J. Baek
759883a4c8 feat: check for updates 2024-02-25 11:55:15 -08:00
Timothy J. Baek
6bfe2a6306 feat: latest release check api 2024-02-25 11:26:58 -08:00
Timothy J. Baek
c8631660c7 Update requirements.txt 2024-02-25 00:58:58 -08:00
Timothy J. Baek
d0c0d0d2b4 fix: litellm config issue 2024-02-24 22:35:11 -08:00
Timothy J. Baek
366679ff7c fix: 'dict' object issue 2024-02-24 22:10:43 -08:00
Timothy Jaeryang Baek
271e5bf44d
Merge branch 'dev' into feature/img-gen-steps-setting 2024-02-24 21:09:06 -05:00
Timothy J. Baek
393531c9b0 fix 2024-02-24 18:08:35 -08:00
Timothy J. Baek
ec6f53e298 feat: litellm proxy frontend integration 2024-02-24 17:56:53 -08:00
Timothy J. Baek
e15e015db1 fix: images 2024-02-24 15:48:14 -08:00
Timothy J. Baek
32da2aa511 Update config.py 2024-02-24 13:11:56 -08:00
Justin Firth
3fa79e59bf Allow configuration of steps, default to a1111 default 2024-02-24 10:44:08 -05:00
Timothy J. Baek
a74d47b6fc Update requirements.txt 2024-02-24 01:27:44 -08:00
Timothy J. Baek
bfba72d486 fix: pip dependency 2024-02-24 01:19:44 -08:00
Timothy J. Baek
43f9a827d3 fix: gitignore 2024-02-24 00:29:03 -08:00
Timothy J. Baek
14dd0d11fb feat: litellm yaml 2024-02-24 00:21:53 -08:00
Timothy J. Baek
b5bd07a06a feat: secure litellm api 2024-02-23 22:44:56 -08:00
Timothy Jaeryang Baek
ee22e641ff
Merge branch 'main' into litellm 2024-02-24 01:10:04 -05:00
Timothy J. Baek
d1f170dc77 fix: error handling 2024-02-23 17:36:38 -08:00
Timothy J. Baek
decba05c7a Update config.py 2024-02-23 17:24:46 -08:00
Timothy J. Baek
62f67bed29 feat: sponsor custom name support 2024-02-23 17:12:19 -08:00
Timothy Jaeryang Baek
a974d736d2
Merge pull request #866 from asedmammad/fix-rag-scan-unsupported-mime
fix: RAG scan unsupported mime type
2024-02-23 14:03:24 -05:00
Ased Mammad
b473ad574f fix: RAG scan unsupported mimetype
This fixes an issue with RAG that stops loading documents as soon
as it reaches a file with unsupported mimetype.
2024-02-23 14:27:31 +03:30
David Girón
214881451d
allow custom default user role 2024-02-23 11:03:06 +01:00
Timothy Jaeryang Baek
8fac9de269
Merge branch 'main' into release-notes-modal 2024-02-23 04:07:16 -05:00
Timothy J. Baek
a84070c6d3 refac: changelog api 2024-02-23 00:36:53 -08:00
Timothy J. Baek
9f950aea9c feat: changelog.md 2024-02-23 00:30:26 -08:00
Timothy J. Baek
7ec4c07bf9 feat: image size param 2024-02-22 19:32:36 -08:00
Timothy J. Baek
de0084c8df feat: litellm integration 2024-02-22 03:22:23 -08:00
Timothy J. Baek
dc705c4984 refac: settings 2024-02-21 19:06:27 -08:00
Timothy J. Baek
797ed9ac7f feat: allow enabling after url is provided 2024-02-21 18:57:53 -08:00
Timothy J. Baek
cc50cc10e6 feat: sd frontend integration 2024-02-21 18:36:40 -08:00
Timothy J. Baek
733e963c44 feat: sd backend integration 2024-02-21 18:12:01 -08:00
Timothy J. Baek
7a730c3f0f refac: versioning using package 2024-02-21 17:10:27 -08:00
Timothy Jaeryang Baek
6d6ab6459d
Merge pull request #815 from open-webui/auth
feat: jwt utils
2024-02-19 23:45:15 -05:00
Timothy J. Baek
275523e32e feat: jwt utils 2024-02-19 20:44:00 -08:00
Timothy J. Baek
5da73824ba Update config.json 2024-02-19 19:46:46 -08:00
Timothy J. Baek
3d10f21b3b feat: include default config.json 2024-02-19 19:28:34 -08:00
Timothy J. Baek
daa989b7dc feat: validate type 2024-02-19 19:09:09 -08:00
Timothy J. Baek
d58de061fa feat: config.json support 2024-02-19 18:54:22 -08:00
Timothy J. Baek
7c127c35fc feat: dynamic embedding model load 2024-02-19 11:05:45 -08:00
Timothy J. Baek
ab104d5905 refac 2024-02-19 10:56:50 -08:00
Jannik Streidl
acf999013b storing vectordb in project cache folder + device types 2024-02-19 07:51:17 +01:00
Timothy J. Baek
0cb0358485 refac: more descriptive var names 2024-02-18 11:16:10 -08:00
Jannik S
4b88e7e44f
Merge branch 'main' into choose-embedding-model 2024-02-18 09:20:54 +01:00
Jannik Streidl
bc3dd34d8b collection query fix 2024-02-18 09:17:43 +01:00
Timothy J. Baek
07b451995e feat: reset rag template 2024-02-17 22:49:18 -08:00
Timothy J. Baek
5270efa9e5 feat: editable rag template 2024-02-17 22:41:03 -08:00
Timothy J. Baek
ccf08fb91e feat: editable chunk params 2024-02-17 22:29:52 -08:00
Timothy J. Baek
a94e4161f7 fix: file content type issue 2024-02-17 21:31:46 -08:00
Timothy J. Baek
e07001e5f6 feat: rag folder scan support 2024-02-17 21:06:08 -08:00
Timothy J. Baek
d1e5274fc9 Update start_windows.bat 2024-02-17 11:25:11 -08:00
Timothy J. Baek
22d2c13713 Update start_windows.bat 2024-02-17 10:43:50 -08:00
Timothy J. Baek
bd9e5c013f feat: start command for windows 2024-02-17 10:41:17 -08:00
Jannik Streidl
1846c1e80d choose embedding model when using docker 2024-02-17 19:38:29 +01:00
Timothy J. Baek
90bcd1644a rename to open-webui 2024-02-16 23:30:38 -08:00
Timothy Jaeryang Baek
1def55cf09
Merge pull request #725 from jnkstr/no-internet-whisper
fix: no internet connection for whisper if you use docker
2024-02-15 02:44:31 -05:00
Timothy J. Baek
63e6f39b31 refac 2024-02-14 23:32:54 -08:00
Timothy J. Baek
434e2c00e9 fix: user display limit 2024-02-14 13:24:40 -08:00
Timothy J. Baek
43b05fa7dd chore: version update 2024-02-14 01:19:39 -08:00
Timothy J. Baek
511e939b5d feat: admin settings 2024-02-14 01:17:43 -08:00
Jannik Streidl
8ab0338e71 no internet connection for whisper if you use docker 2024-02-13 15:11:53 +01:00
Timothy J. Baek
2ef4fc1215 fix: strip transcription text 2024-02-11 02:17:24 -08:00
Timothy J. Baek
98496a7055 feat: update default whisper model 2024-02-11 02:15:54 -08:00
Timothy J. Baek
a5b9bbf10b feat: whisper support 2024-02-11 00:17:50 -08:00
Timothy J. Baek
3af8d16e6a fix: admin issue 2024-02-10 17:54:33 -08:00
Timothy Jaeryang Baek
9f3346a6ec
Merge pull request #682 from explorigin/simplify-endpoint-code
Simplify endpoint role checking
2024-02-09 14:26:56 -08:00
Tim Farrell
08e8e922fd Endpoint role-checking was redundantly applied but FastAPI provides a nice abstraction mechanic...so I applied it. There should be no logical changes in this code; only simpler, cleaner ways for doing the same thing. 2024-02-08 18:05:01 -06:00
Kyle McLaren
d4fec48d9c
get ENABLE_SIGNUP from env 2024-02-06 20:58:07 +02:00
Timothy J. Baek
519e27978f refac 2024-02-05 22:58:02 -08:00
Timothy J. Baek
1b040143eb feat: cache request body 2024-02-05 22:57:24 -08:00
Timothy J. Baek
0b8df52c97 feat: openai tts support 2024-02-05 22:51:08 -08:00
Timothy J. Baek
8468c18059 Update .gitignore 2024-02-04 21:29:04 -08:00
Timothy J. Baek
7c2f297c84 feat: export all chats from db
admin only
2024-02-04 01:07:18 -08:00
Timothy J. Baek
f73a1fc4ea chore: version update 2024-02-03 17:42:08 -08:00
Timothy Jaeryang Baek
323ec3787e
Merge pull request #624 from explorigin/session-security
Improve Session Security
2024-02-03 17:41:31 -08:00
Timothy Jaeryang Baek
1f02940bbd
Merge pull request #617 from ollama-webui/doc-collection
feat: document collection
2024-02-03 17:28:11 -08:00
Timothy J. Baek
683650ec00 feat: collection rag integration 2024-02-03 15:57:06 -08:00
Timothy J. Baek
00803c92f2 feat: doc tagging 2024-02-03 14:44:49 -08:00
Tim Farrell
8298cefd62 Fix bash condition formatting 2024-02-02 09:02:48 -06:00
Tim Farrell
1031638d82 Maintain backward compatibility with WEBUI_JWT_SECRET_KEY for the time being 2024-02-02 09:02:35 -06:00
Tim Farrell
e2d481d99a Move the random secret generation to start.sh.
This way the random secret is created on first run instead of docker build. We don't really want all standard imaages to share a password anymore than we want a static password.
2024-02-02 09:02:23 -06:00
Tim Farrell
44799e2018 Remove some extraneous imports 2024-02-02 09:02:07 -06:00
Tim Farrell
4fceb404bd Call jwt.decode with the expected algorithms 2024-02-02 09:01:57 -06:00
Tim Farrell
e15dbdc46a Pass the instance we're using. 2024-02-02 09:01:34 -06:00
Tim Farrell
8c37edd027 Even though "User.email" is enforced as unique at signup, it is not a unique field in the database. Let's use "User.id" instead. This also makes it more difficult to do a session stealing attack. 2024-02-02 09:01:06 -06:00
Tim Farrell
2c1dacb9b6 We should verify signatures to make the whole session secret meaningful. 2024-02-02 09:00:31 -06:00
Tim Farrell
03a7e35967 Default docker installations should generate a random key instead of using a static secret that everyone can see. 2024-02-02 08:59:46 -06:00
Tim Farrell
d67f3d982b Start by renaming variables to something more generic. This will give us a bit more flexibility as we look to other session management mechanisms. 2024-02-02 08:58:13 -06:00
Self Denial
6c1e69cac2 Disable Chroma telemetry 2024-02-01 17:29:09 -07:00
Timothy J. Baek
50f7b20ac2 refac 2024-02-01 13:35:41 -08:00
Timothy J. Baek
28226a6f97 feat: web rag support 2024-01-26 22:17:28 -08:00
Timothy J. Baek
0c322063b5 feat: use local profile image by default 2024-01-26 21:38:33 -08:00
Timothy J. Baek
3ce8f3e8fb feat: profile update frontend integration 2024-01-26 21:22:25 -08:00
Timothy J. Baek
418da74756 feat: profile image update backend 2024-01-26 20:27:45 -08:00
Timothy Jaeryang Baek
d6b139cfe9
Merge pull request #559 from peperunas/patch-2
fix: use exec the uvicorn process to handle Docker's SIGTERM correctly
2024-01-25 00:47:45 -08:00
Timothy Jaeryang Baek
a243e53bfe
Merge pull request #536 from lucasew/backend-data-dir
Unhardcode some stuff, flexibilize dotenv requirement
2024-01-25 00:42:12 -08:00
Timothy J. Baek
326af5a648 refac 2024-01-25 00:40:19 -08:00
Timothy J. Baek
4e468dc58c refac 2024-01-25 00:24:49 -08:00
Timothy Jaeryang Baek
fa5918ad13
Merge branch 'main' into main 2024-01-25 00:13:12 -08:00
Giulio De Pasquale
1cbbfc7c66
fix: use exec the uvicorn process to handle Docker's SIGTERM correctly
Replace the shell with the uvicorn process, so it becomes PID 1 and receives the signals directly
2024-01-24 17:57:35 +00:00
Marclass
8bfda730d9 add excel document support 2024-01-23 14:03:22 -07:00
lucasew
8da06f5e74 fixes after the refactor
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-23 12:59:52 -03:00
Timothy Jaeryang Baek
ca943d0795
Merge pull request #549 from Marclass/main
Bugfix: Fix toast error popup when front end can't figure out file type.
2024-01-22 23:13:53 -08:00
Timothy Jaeryang Baek
7054f02891
Merge pull request #466 from baumandm/feat/epub-support
feat: Add epub support
2024-01-22 23:12:46 -08:00
Marclass
7eea3ef313 copy list of file ext from backend to front end 2024-01-23 00:00:07 -07:00
Timothy Jaeryang Baek
d517a3ebb4
Merge pull request #547 from Marclass/main
feat: Add reStructuredText specific parser for RAG
2024-01-22 22:19:41 -08:00
Timothy J. Baek
c4a039326f feat: editable prompt suggestions integration 2024-01-22 21:53:13 -08:00
Timothy J. Baek
4e1b52e91b feat: custom interface support 2024-01-22 21:07:40 -08:00
Marclass
2e4373c63e
Merge branch 'ollama-webui:main' into main 2024-01-22 21:01:33 -07:00
Timothy J. Baek
d67c632920 fix: openai 2024-01-22 09:45:56 -08:00
Timothy J. Baek
d2c5f3d591 refac: convert str var to f-string 2024-01-22 01:47:07 -08:00
Timothy Jaeryang Baek
1abe5a5487
Merge pull request #537 from CreatorGhost/fix-gpt-4-vision
Add max_tokens workaround for gpt-4-vision-preview model
2024-01-22 01:41:57 -08:00
Timothy J. Baek
83181b7968 fix: add max_token only when field not present 2024-01-22 01:41:00 -08:00
Timothy J. Baek
b26e0fb7e7 refac 2024-01-22 01:37:54 -08:00
Shiyinq
6a63c94153 feat: add guard clause to improve signup process 2024-01-20 21:54:53 +07:00
Aditya Pratap Singh
60afd6ecdd Add workaround for gpt-4-vision-preview model that support 4k tokens 2024-01-20 04:34:47 +05:30
Aditya Pratap Singh
8662437a9f Add workaround for gpt-4-vision-preview model 2024-01-20 04:17:06 +05:30
lucasew
5b26d2a686 backend: make the data directory and the artifacts from the frontend customizable using environment variables
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:13:09 -03:00
lucasew
e3503d6617 backend: make dotenv optional
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:12:14 -03:00
Marclass
35ace57784 add rst document for RAG 2024-01-19 10:48:04 -07:00
Dave Bauman
f559068186
feat: Add epub support 2024-01-19 12:23:59 -05:00
Timothy Jaeryang Baek
f079cb6b56
Merge pull request #524 from Marclass/rag-arbitrary-files
feat: Allow RAG on XML and arbitrary text files including source code
2024-01-19 00:09:04 -08:00
Marclass
aa1d386042 Allow any file to be used for RAG.
Changed RAG parser to prefer file extensions over MIME content types. If the type of file is not recognized assume it's a text file.
2024-01-18 20:41:14 -07:00
Timothy J. Baek
220530c450 feat: convo tag filtering 2024-01-18 02:55:25 -08:00
Timothy J. Baek
1eec176313 feat: save tags to chat data 2024-01-18 02:17:31 -08:00
Timothy J. Baek
987685dbf9 feat: convo tagging full integration 2024-01-18 02:10:07 -08:00
Timothy J. Baek
d5ed119687 feat: convo tagging api added 2024-01-18 01:04:24 -08:00
Timothy J. Baek
077f1fa34b feat: convo tagging backend support 2024-01-18 00:58:45 -08:00
Timothy J. Baek
442e3d978a feat: terminate request on user stop 2024-01-17 19:19:44 -08:00
Marclass
6070e6bcd1 add svelte type to RAG 2024-01-17 20:10:34 -07:00
Marclass
8dacc86ab0
Merge branch 'ollama-webui:main' into main 2024-01-17 16:20:52 -07:00
Timothy Jaeryang Baek
89b35e4556
Merge pull request #504 from mslinn/fix1
This script can now be run from any directory
2024-01-17 15:00:24 -08:00
Timothy J. Baek
b6ab357e8c fix: more edge cases 2024-01-17 14:47:56 -08:00
Mike Slinn
f9885a15e4 Can now run from any directory 2024-01-17 17:30:58 -05:00
Marclass
cf6b3fa48a remove html type and add js/css 2024-01-17 00:34:22 -07:00
Marclass
43d8466677 feat: Add RAG support for various programming languages
Enables RAG for golang, python, java, sh, bat, powershell, cmd, js, css, c/c++/c#, sql, logs, ini, perl, r, dart, docker, env, php, haskell, lua, conf, plsql, ruby, db2, scalla, bash, swift, vue, html, xml, and other arbitrary text files.
2024-01-17 00:09:47 -07:00
Timothy J. Baek
0e039492c6 refac: SERVER_PORT renamed to PORT 2024-01-12 19:38:30 -08:00
Anuraag Jain
a63507c21e feat: custom port for server 2024-01-11 21:54:14 +02:00
goecho
74f91bc74d Fix bug: Header attributes (Host, Authorization, Origin, Referer) not sanitized
- Resolved an issue where header attributes Host, Authorization, Origin, and Referer were not being sanitized, resulting in two major issues:
  1. Ollama requests inadvertently exposed user information, leading to data leakage.
  2. When Ollama is deployed on different servers, and the intermediary proxy layer uses the host header to locate downstream services, it fails to find them.

Root Cause:
- In FastAPI, when accessing request.headers, all header names are converted to lowercase. This is because FastAPI, and its underlying framework Starlette, adhere to the HTTP/2 standard, which mandates lowercase header field names for performance and consistency.
- In HTTP/2, enforcing lowercase header field names reduces complexity in header processing as case sensitivity is no longer a concern. Thus, regardless of the case used in client-sent header fields, the server processes them uniformly in lowercase.
- This practice is adopted in FastAPI and other modern HTTP frameworks, even in an HTTP/1.1 context, to maintain consistency with HTTP/2 and improve overall performance. As a result, header field names are always presented in lowercase in FastAPI, even if the original request used capitalization or mixed case.
2024-01-11 14:36:34 +08:00
Timothy J. Baek
ffba59dc3a Update requirements.txt 2024-01-09 21:09:28 -08:00
Timothy J. Baek
c1ec604f21 feat: rag md support 2024-01-09 15:24:53 -08:00
Timothy J. Baek
76d37393ee feat: gguf upload 2024-01-09 13:25:42 -08:00
Timothy J. Baek
1ff3eb8038 feat: doc upload error handling 2024-01-08 01:54:03 -08:00
Timothy J. Baek
eddb6fc7b7 feat: documents backend integration 2024-01-08 01:49:20 -08:00
Timothy J. Baek
54c4e0761a feat: documents file upload 2024-01-08 01:26:15 -08:00
Timothy J. Baek
cc3f84f916 feat: # to import doc 2024-01-07 23:43:32 -08:00
Timothy J. Baek
2603ac30bc feat: documents 2024-01-07 22:14:08 -08:00
Timothy J. Baek
02f364bfd9 fix: dockerfile 2024-01-07 21:22:37 -08:00
Timothy J. Baek
706a8d4f8d fix 2024-01-07 21:14:20 -08:00
Timothy J. Baek
162641ee43 Update requirements.txt 2024-01-07 19:54:52 -08:00
Timothy J. Baek
57c050326c feat: docx support 2024-01-07 13:56:01 -08:00
Timothy J. Baek
9a63376e55 feat: file upload error handling 2024-01-07 09:33:34 -08:00
Timothy J. Baek
b37b157638 feat: reset vectordb storage support 2024-01-07 09:15:45 -08:00
Timothy J. Baek
d4b2578f6e feat: rag csv support 2024-01-07 09:05:52 -08:00
Timothy J. Baek
d6a1bf1406 refac: file upload 2024-01-07 09:00:30 -08:00
Timothy J. Baek
ffd0a5a2a0 Update main.py 2024-01-07 08:34:05 -08:00
Timothy J. Baek
c68bb3b950 docker: slim 2024-01-07 08:28:35 -08:00
Timothy Jaeryang Baek
34e0f64fb3
Merge pull request #333 from ollama-webui/rag
feat: RAG support
2024-01-07 02:50:32 -08:00
Timothy J. Baek
464d0fb016 fix: update langchain.document_loaders 2024-01-07 02:49:13 -08:00
Timothy J. Baek
04db2475f9 fix: disable swagger doc in prod 2024-01-07 02:48:21 -08:00
Timothy J. Baek
70d2571be1 feat: rag backend auth 2024-01-07 02:46:12 -08:00
Timothy J. Baek
c43df8850f fix: requirements 2024-01-07 02:45:56 -08:00
Timothy J. Baek
142269374f feat: vectordb query error handling 2024-01-07 01:59:00 -08:00
Timothy J. Baek
ad3d69be30 refac 2024-01-07 01:54:58 -08:00
Timothy J. Baek
9634e2da3e feat: full integration 2024-01-07 01:40:36 -08:00
Timothy J. Baek
fef4725d56 feat: frontend file upload support 2024-01-07 00:57:10 -08:00
Timothy J. Baek
cd86c36953 feat: pdf data load 2024-01-06 23:40:51 -08:00
Timothy J. Baek
784b369cc9 feat: chromadb vector store api 2024-01-06 22:59:22 -08:00
Timothy J. Baek
b2c9f6dff8 feat: rag api endpoint 2024-01-06 22:07:20 -08:00
Timothy J. Baek
82114c45ee fix: allow command named create 2024-01-06 17:55:41 -08:00
Timothy Jaeryang Baek
7071716f54
Merge pull request #408 from ollama-webui/main
rag
2024-01-06 17:33:52 -08:00
Timothy J. Baek
73b88a8c17 fix: update user email issue 2024-01-06 02:51:57 -08:00
Timothy J. Baek
e441875af7 fix: update role 2024-01-05 21:02:49 -08:00
Timothy J. Baek
fb0c64379d feat: edit user support 2024-01-05 20:59:56 -08:00
Timothy J. Baek
bb2971260d fix: backend proxy 2024-01-05 17:16:35 -08:00
Timothy J. Baek
78477baa0e feat: proxy logging 2024-01-05 15:51:33 -08:00
Timothy J. Baek
5e6d946f83 chore: disable passlib log 2024-01-05 12:22:27 -08:00
Timothy J. Baek
a37b9c126f refac 2024-01-05 01:29:04 -08:00
Timothy J. Baek
47dc3b5fb2 feat: async reverse proxy 2024-01-05 01:25:34 -08:00
ThatOneCalculator
699fbefb8a
chore: 🎨 format 2024-01-04 20:05:19 -08:00
Timothy Jaeryang Baek
1a93191259
Merge branch 'main' into bun 2024-01-04 22:57:11 -05:00
Timothy J. Baek
a96795d752 chore: version 2024-01-04 19:02:57 -08:00
Timothy J. Baek
c0b099da4f feat: openai frontend refac 2024-01-04 18:54:00 -08:00
Timothy J. Baek
17c66fde0f feat: openai compatible api support 2024-01-04 18:38:03 -08:00
Timothy J. Baek
5e4dc98f44 feat: openai backend support 2024-01-04 16:49:34 -08:00
ThatOneCalculator
05fade1426
chore: 🎨 format backend 2024-01-04 13:30:47 -08:00
ThatOneCalculator
8480a9b418
Merge branch 'main' into bun 2024-01-04 13:30:30 -08:00
Timothy J. Baek
30aff2db53 feat: enable backend ollama url update 2024-01-04 13:06:31 -08:00
Timothy Jaeryang Baek
fa598b59e2
Merge branch 'main' into rag 2024-01-04 01:02:42 -05:00
Kainoa Kanter
947013c74d
Merge branch 'main' into bun 2024-01-03 17:13:57 -08:00
ThatOneCalculator
6e78b3a8f6
fix: 🔨 start script permissions & environment 2024-01-03 15:56:11 -08:00