Commit graph

223 commits

Author SHA1 Message Date
Timothy J. Baek
733e963c44 feat: sd backend integration 2024-02-21 18:12:01 -08:00
Timothy J. Baek
7a730c3f0f refac: versioning using package 2024-02-21 17:10:27 -08:00
Timothy J. Baek
275523e32e feat: jwt utils 2024-02-19 20:44:00 -08:00
Timothy J. Baek
7c127c35fc feat: dynamic embedding model load 2024-02-19 11:05:45 -08:00
Jannik Streidl
acf999013b storing vectordb in project cache folder + device types 2024-02-19 07:51:17 +01:00
Timothy J. Baek
0cb0358485 refac: more descriptive var names 2024-02-18 11:16:10 -08:00
Jannik S
4b88e7e44f
Merge branch 'main' into choose-embedding-model 2024-02-18 09:20:54 +01:00
Jannik Streidl
bc3dd34d8b collection query fix 2024-02-18 09:17:43 +01:00
Timothy J. Baek
07b451995e feat: reset rag template 2024-02-17 22:49:18 -08:00
Timothy J. Baek
5270efa9e5 feat: editable rag template 2024-02-17 22:41:03 -08:00
Timothy J. Baek
ccf08fb91e feat: editable chunk params 2024-02-17 22:29:52 -08:00
Timothy J. Baek
a94e4161f7 fix: file content type issue 2024-02-17 21:31:46 -08:00
Timothy J. Baek
e07001e5f6 feat: rag folder scan support 2024-02-17 21:06:08 -08:00
Jannik Streidl
1846c1e80d choose embedding model when using docker 2024-02-17 19:38:29 +01:00
Timothy J. Baek
90bcd1644a rename to open-webui 2024-02-16 23:30:38 -08:00
Timothy Jaeryang Baek
1def55cf09
Merge pull request #725 from jnkstr/no-internet-whisper
fix: no internet connection for whisper if you use docker
2024-02-15 02:44:31 -05:00
Timothy J. Baek
63e6f39b31 refac 2024-02-14 23:32:54 -08:00
Timothy J. Baek
434e2c00e9 fix: user display limit 2024-02-14 13:24:40 -08:00
Timothy J. Baek
511e939b5d feat: admin settings 2024-02-14 01:17:43 -08:00
Jannik Streidl
8ab0338e71 no internet connection for whisper if you use docker 2024-02-13 15:11:53 +01:00
Timothy J. Baek
2ef4fc1215 fix: strip transcription text 2024-02-11 02:17:24 -08:00
Timothy J. Baek
a5b9bbf10b feat: whisper support 2024-02-11 00:17:50 -08:00
Timothy J. Baek
3af8d16e6a fix: admin issue 2024-02-10 17:54:33 -08:00
Timothy Jaeryang Baek
9f3346a6ec
Merge pull request #682 from explorigin/simplify-endpoint-code
Simplify endpoint role checking
2024-02-09 14:26:56 -08:00
Tim Farrell
08e8e922fd Endpoint role-checking was redundantly applied but FastAPI provides a nice abstraction mechanic...so I applied it. There should be no logical changes in this code; only simpler, cleaner ways for doing the same thing. 2024-02-08 18:05:01 -06:00
Kyle McLaren
d4fec48d9c
get ENABLE_SIGNUP from env 2024-02-06 20:58:07 +02:00
Timothy J. Baek
519e27978f refac 2024-02-05 22:58:02 -08:00
Timothy J. Baek
1b040143eb feat: cache request body 2024-02-05 22:57:24 -08:00
Timothy J. Baek
0b8df52c97 feat: openai tts support 2024-02-05 22:51:08 -08:00
Timothy J. Baek
7c2f297c84 feat: export all chats from db
admin only
2024-02-04 01:07:18 -08:00
Timothy Jaeryang Baek
323ec3787e
Merge pull request #624 from explorigin/session-security
Improve Session Security
2024-02-03 17:41:31 -08:00
Timothy J. Baek
683650ec00 feat: collection rag integration 2024-02-03 15:57:06 -08:00
Timothy J. Baek
00803c92f2 feat: doc tagging 2024-02-03 14:44:49 -08:00
Tim Farrell
44799e2018 Remove some extraneous imports 2024-02-02 09:02:07 -06:00
Tim Farrell
8c37edd027 Even though "User.email" is enforced as unique at signup, it is not a unique field in the database. Let's use "User.id" instead. This also makes it more difficult to do a session stealing attack. 2024-02-02 09:01:06 -06:00
Timothy J. Baek
50f7b20ac2 refac 2024-02-01 13:35:41 -08:00
Timothy J. Baek
28226a6f97 feat: web rag support 2024-01-26 22:17:28 -08:00
Timothy J. Baek
0c322063b5 feat: use local profile image by default 2024-01-26 21:38:33 -08:00
Timothy J. Baek
3ce8f3e8fb feat: profile update frontend integration 2024-01-26 21:22:25 -08:00
Timothy J. Baek
418da74756 feat: profile image update backend 2024-01-26 20:27:45 -08:00
Timothy Jaeryang Baek
a243e53bfe
Merge pull request #536 from lucasew/backend-data-dir
Unhardcode some stuff, flexibilize dotenv requirement
2024-01-25 00:42:12 -08:00
Timothy J. Baek
4e468dc58c refac 2024-01-25 00:24:49 -08:00
Timothy Jaeryang Baek
fa5918ad13
Merge branch 'main' into main 2024-01-25 00:13:12 -08:00
Marclass
8bfda730d9 add excel document support 2024-01-23 14:03:22 -07:00
lucasew
8da06f5e74 fixes after the refactor
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-23 12:59:52 -03:00
Timothy Jaeryang Baek
ca943d0795
Merge pull request #549 from Marclass/main
Bugfix: Fix toast error popup when front end can't figure out file type.
2024-01-22 23:13:53 -08:00
Timothy Jaeryang Baek
7054f02891
Merge pull request #466 from baumandm/feat/epub-support
feat: Add epub support
2024-01-22 23:12:46 -08:00
Marclass
7eea3ef313 copy list of file ext from backend to front end 2024-01-23 00:00:07 -07:00
Timothy Jaeryang Baek
d517a3ebb4
Merge pull request #547 from Marclass/main
feat: Add reStructuredText specific parser for RAG
2024-01-22 22:19:41 -08:00
Timothy J. Baek
c4a039326f feat: editable prompt suggestions integration 2024-01-22 21:53:13 -08:00
Timothy J. Baek
4e1b52e91b feat: custom interface support 2024-01-22 21:07:40 -08:00
Marclass
2e4373c63e
Merge branch 'ollama-webui:main' into main 2024-01-22 21:01:33 -07:00
Timothy J. Baek
d67c632920 fix: openai 2024-01-22 09:45:56 -08:00
Timothy J. Baek
d2c5f3d591 refac: convert str var to f-string 2024-01-22 01:47:07 -08:00
Timothy Jaeryang Baek
1abe5a5487
Merge pull request #537 from CreatorGhost/fix-gpt-4-vision
Add max_tokens workaround for gpt-4-vision-preview model
2024-01-22 01:41:57 -08:00
Timothy J. Baek
83181b7968 fix: add max_token only when field not present 2024-01-22 01:41:00 -08:00
Timothy J. Baek
b26e0fb7e7 refac 2024-01-22 01:37:54 -08:00
Shiyinq
6a63c94153 feat: add guard clause to improve signup process 2024-01-20 21:54:53 +07:00
Aditya Pratap Singh
60afd6ecdd Add workaround for gpt-4-vision-preview model that support 4k tokens 2024-01-20 04:34:47 +05:30
Aditya Pratap Singh
8662437a9f Add workaround for gpt-4-vision-preview model 2024-01-20 04:17:06 +05:30
lucasew
5b26d2a686 backend: make the data directory and the artifacts from the frontend customizable using environment variables
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:13:09 -03:00
Marclass
35ace57784 add rst document for RAG 2024-01-19 10:48:04 -07:00
Dave Bauman
f559068186
feat: Add epub support 2024-01-19 12:23:59 -05:00
Timothy Jaeryang Baek
f079cb6b56
Merge pull request #524 from Marclass/rag-arbitrary-files
feat: Allow RAG on XML and arbitrary text files including source code
2024-01-19 00:09:04 -08:00
Marclass
aa1d386042 Allow any file to be used for RAG.
Changed RAG parser to prefer file extensions over MIME content types. If the type of file is not recognized assume it's a text file.
2024-01-18 20:41:14 -07:00
Timothy J. Baek
220530c450 feat: convo tag filtering 2024-01-18 02:55:25 -08:00
Timothy J. Baek
1eec176313 feat: save tags to chat data 2024-01-18 02:17:31 -08:00
Timothy J. Baek
987685dbf9 feat: convo tagging full integration 2024-01-18 02:10:07 -08:00
Timothy J. Baek
d5ed119687 feat: convo tagging api added 2024-01-18 01:04:24 -08:00
Timothy J. Baek
077f1fa34b feat: convo tagging backend support 2024-01-18 00:58:45 -08:00
Timothy J. Baek
442e3d978a feat: terminate request on user stop 2024-01-17 19:19:44 -08:00
Marclass
6070e6bcd1 add svelte type to RAG 2024-01-17 20:10:34 -07:00
Marclass
8dacc86ab0
Merge branch 'ollama-webui:main' into main 2024-01-17 16:20:52 -07:00
Timothy J. Baek
b6ab357e8c fix: more edge cases 2024-01-17 14:47:56 -08:00
Marclass
cf6b3fa48a remove html type and add js/css 2024-01-17 00:34:22 -07:00
Marclass
43d8466677 feat: Add RAG support for various programming languages
Enables RAG for golang, python, java, sh, bat, powershell, cmd, js, css, c/c++/c#, sql, logs, ini, perl, r, dart, docker, env, php, haskell, lua, conf, plsql, ruby, db2, scalla, bash, swift, vue, html, xml, and other arbitrary text files.
2024-01-17 00:09:47 -07:00
goecho
74f91bc74d Fix bug: Header attributes (Host, Authorization, Origin, Referer) not sanitized
- Resolved an issue where header attributes Host, Authorization, Origin, and Referer were not being sanitized, resulting in two major issues:
  1. Ollama requests inadvertently exposed user information, leading to data leakage.
  2. When Ollama is deployed on different servers, and the intermediary proxy layer uses the host header to locate downstream services, it fails to find them.

Root Cause:
- In FastAPI, when accessing request.headers, all header names are converted to lowercase. This is because FastAPI, and its underlying framework Starlette, adhere to the HTTP/2 standard, which mandates lowercase header field names for performance and consistency.
- In HTTP/2, enforcing lowercase header field names reduces complexity in header processing as case sensitivity is no longer a concern. Thus, regardless of the case used in client-sent header fields, the server processes them uniformly in lowercase.
- This practice is adopted in FastAPI and other modern HTTP frameworks, even in an HTTP/1.1 context, to maintain consistency with HTTP/2 and improve overall performance. As a result, header field names are always presented in lowercase in FastAPI, even if the original request used capitalization or mixed case.
2024-01-11 14:36:34 +08:00
Timothy J. Baek
c1ec604f21 feat: rag md support 2024-01-09 15:24:53 -08:00
Timothy J. Baek
76d37393ee feat: gguf upload 2024-01-09 13:25:42 -08:00
Timothy J. Baek
1ff3eb8038 feat: doc upload error handling 2024-01-08 01:54:03 -08:00
Timothy J. Baek
eddb6fc7b7 feat: documents backend integration 2024-01-08 01:49:20 -08:00
Timothy J. Baek
54c4e0761a feat: documents file upload 2024-01-08 01:26:15 -08:00
Timothy J. Baek
cc3f84f916 feat: # to import doc 2024-01-07 23:43:32 -08:00
Timothy J. Baek
57c050326c feat: docx support 2024-01-07 13:56:01 -08:00
Timothy J. Baek
9a63376e55 feat: file upload error handling 2024-01-07 09:33:34 -08:00
Timothy J. Baek
b37b157638 feat: reset vectordb storage support 2024-01-07 09:15:45 -08:00
Timothy J. Baek
d4b2578f6e feat: rag csv support 2024-01-07 09:05:52 -08:00
Timothy J. Baek
d6a1bf1406 refac: file upload 2024-01-07 09:00:30 -08:00
Timothy J. Baek
ffd0a5a2a0 Update main.py 2024-01-07 08:34:05 -08:00
Timothy J. Baek
c68bb3b950 docker: slim 2024-01-07 08:28:35 -08:00
Timothy Jaeryang Baek
34e0f64fb3
Merge pull request #333 from ollama-webui/rag
feat: RAG support
2024-01-07 02:50:32 -08:00
Timothy J. Baek
464d0fb016 fix: update langchain.document_loaders 2024-01-07 02:49:13 -08:00
Timothy J. Baek
70d2571be1 feat: rag backend auth 2024-01-07 02:46:12 -08:00
Timothy J. Baek
142269374f feat: vectordb query error handling 2024-01-07 01:59:00 -08:00
Timothy J. Baek
ad3d69be30 refac 2024-01-07 01:54:58 -08:00
Timothy J. Baek
9634e2da3e feat: full integration 2024-01-07 01:40:36 -08:00
Timothy J. Baek
fef4725d56 feat: frontend file upload support 2024-01-07 00:57:10 -08:00
Timothy J. Baek
cd86c36953 feat: pdf data load 2024-01-06 23:40:51 -08:00
Timothy J. Baek
784b369cc9 feat: chromadb vector store api 2024-01-06 22:59:22 -08:00
Timothy J. Baek
b2c9f6dff8 feat: rag api endpoint 2024-01-06 22:07:20 -08:00