Commit graph

150 commits

Author SHA1 Message Date
Timothy J. Baek
326af5a648 refac 2024-01-25 00:40:19 -08:00
lucasew
8da06f5e74 fixes after the refactor
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-23 12:59:52 -03:00
Timothy J. Baek
d2c5f3d591 refac: convert str var to f-string 2024-01-22 01:47:07 -08:00
lucasew
5b26d2a686 backend: make the data directory and the artifacts from the frontend customizable using environment variables
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:13:09 -03:00
lucasew
e3503d6617 backend: make dotenv optional
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:12:14 -03:00
Timothy Jaeryang Baek
f079cb6b56
Merge pull request #524 from Marclass/rag-arbitrary-files
feat: Allow RAG on XML and arbitrary text files including source code
2024-01-19 00:09:04 -08:00
Marclass
aa1d386042 Allow any file to be used for RAG.
Changed RAG parser to prefer file extensions over MIME content types. If the type of file is not recognized assume it's a text file.
2024-01-18 20:41:14 -07:00
Timothy J. Baek
220530c450 feat: convo tag filtering 2024-01-18 02:55:25 -08:00
Timothy J. Baek
1eec176313 feat: save tags to chat data 2024-01-18 02:17:31 -08:00
Timothy J. Baek
987685dbf9 feat: convo tagging full integration 2024-01-18 02:10:07 -08:00
Timothy J. Baek
d5ed119687 feat: convo tagging api added 2024-01-18 01:04:24 -08:00
Timothy J. Baek
077f1fa34b feat: convo tagging backend support 2024-01-18 00:58:45 -08:00
Timothy J. Baek
442e3d978a feat: terminate request on user stop 2024-01-17 19:19:44 -08:00
Marclass
6070e6bcd1 add svelte type to RAG 2024-01-17 20:10:34 -07:00
Marclass
8dacc86ab0
Merge branch 'ollama-webui:main' into main 2024-01-17 16:20:52 -07:00
Timothy Jaeryang Baek
89b35e4556
Merge pull request #504 from mslinn/fix1
This script can now be run from any directory
2024-01-17 15:00:24 -08:00
Timothy J. Baek
b6ab357e8c fix: more edge cases 2024-01-17 14:47:56 -08:00
Mike Slinn
f9885a15e4 Can now run from any directory 2024-01-17 17:30:58 -05:00
Marclass
cf6b3fa48a remove html type and add js/css 2024-01-17 00:34:22 -07:00
Marclass
43d8466677 feat: Add RAG support for various programming languages
Enables RAG for golang, python, java, sh, bat, powershell, cmd, js, css, c/c++/c#, sql, logs, ini, perl, r, dart, docker, env, php, haskell, lua, conf, plsql, ruby, db2, scalla, bash, swift, vue, html, xml, and other arbitrary text files.
2024-01-17 00:09:47 -07:00
Timothy J. Baek
0e039492c6 refac: SERVER_PORT renamed to PORT 2024-01-12 19:38:30 -08:00
Anuraag Jain
a63507c21e feat: custom port for server 2024-01-11 21:54:14 +02:00
goecho
74f91bc74d Fix bug: Header attributes (Host, Authorization, Origin, Referer) not sanitized
- Resolved an issue where header attributes Host, Authorization, Origin, and Referer were not being sanitized, resulting in two major issues:
  1. Ollama requests inadvertently exposed user information, leading to data leakage.
  2. When Ollama is deployed on different servers, and the intermediary proxy layer uses the host header to locate downstream services, it fails to find them.

Root Cause:
- In FastAPI, when accessing request.headers, all header names are converted to lowercase. This is because FastAPI, and its underlying framework Starlette, adhere to the HTTP/2 standard, which mandates lowercase header field names for performance and consistency.
- In HTTP/2, enforcing lowercase header field names reduces complexity in header processing as case sensitivity is no longer a concern. Thus, regardless of the case used in client-sent header fields, the server processes them uniformly in lowercase.
- This practice is adopted in FastAPI and other modern HTTP frameworks, even in an HTTP/1.1 context, to maintain consistency with HTTP/2 and improve overall performance. As a result, header field names are always presented in lowercase in FastAPI, even if the original request used capitalization or mixed case.
2024-01-11 14:36:34 +08:00
Timothy J. Baek
ffba59dc3a Update requirements.txt 2024-01-09 21:09:28 -08:00
Timothy J. Baek
c1ec604f21 feat: rag md support 2024-01-09 15:24:53 -08:00
Timothy J. Baek
76d37393ee feat: gguf upload 2024-01-09 13:25:42 -08:00
Timothy J. Baek
1ff3eb8038 feat: doc upload error handling 2024-01-08 01:54:03 -08:00
Timothy J. Baek
eddb6fc7b7 feat: documents backend integration 2024-01-08 01:49:20 -08:00
Timothy J. Baek
54c4e0761a feat: documents file upload 2024-01-08 01:26:15 -08:00
Timothy J. Baek
cc3f84f916 feat: # to import doc 2024-01-07 23:43:32 -08:00
Timothy J. Baek
2603ac30bc feat: documents 2024-01-07 22:14:08 -08:00
Timothy J. Baek
02f364bfd9 fix: dockerfile 2024-01-07 21:22:37 -08:00
Timothy J. Baek
706a8d4f8d fix 2024-01-07 21:14:20 -08:00
Timothy J. Baek
162641ee43 Update requirements.txt 2024-01-07 19:54:52 -08:00
Timothy J. Baek
57c050326c feat: docx support 2024-01-07 13:56:01 -08:00
Timothy J. Baek
9a63376e55 feat: file upload error handling 2024-01-07 09:33:34 -08:00
Timothy J. Baek
b37b157638 feat: reset vectordb storage support 2024-01-07 09:15:45 -08:00
Timothy J. Baek
d4b2578f6e feat: rag csv support 2024-01-07 09:05:52 -08:00
Timothy J. Baek
d6a1bf1406 refac: file upload 2024-01-07 09:00:30 -08:00
Timothy J. Baek
ffd0a5a2a0 Update main.py 2024-01-07 08:34:05 -08:00
Timothy J. Baek
c68bb3b950 docker: slim 2024-01-07 08:28:35 -08:00
Timothy Jaeryang Baek
34e0f64fb3
Merge pull request #333 from ollama-webui/rag
feat: RAG support
2024-01-07 02:50:32 -08:00
Timothy J. Baek
464d0fb016 fix: update langchain.document_loaders 2024-01-07 02:49:13 -08:00
Timothy J. Baek
04db2475f9 fix: disable swagger doc in prod 2024-01-07 02:48:21 -08:00
Timothy J. Baek
70d2571be1 feat: rag backend auth 2024-01-07 02:46:12 -08:00
Timothy J. Baek
c43df8850f fix: requirements 2024-01-07 02:45:56 -08:00
Timothy J. Baek
142269374f feat: vectordb query error handling 2024-01-07 01:59:00 -08:00
Timothy J. Baek
ad3d69be30 refac 2024-01-07 01:54:58 -08:00
Timothy J. Baek
9634e2da3e feat: full integration 2024-01-07 01:40:36 -08:00
Timothy J. Baek
fef4725d56 feat: frontend file upload support 2024-01-07 00:57:10 -08:00