Timothy Jaeryang Baek
f079cb6b56
Merge pull request #524 from Marclass/rag-arbitrary-files
...
feat: Allow RAG on XML and arbitrary text files including source code
2024-01-19 00:09:04 -08:00
Marclass
aa1d386042
Allow any file to be used for RAG.
...
Changed RAG parser to prefer file extensions over MIME content types. If the type of file is not recognized assume it's a text file.
2024-01-18 20:41:14 -07:00
Timothy J. Baek
220530c450
feat: convo tag filtering
2024-01-18 02:55:25 -08:00
Timothy J. Baek
1eec176313
feat: save tags to chat data
2024-01-18 02:17:31 -08:00
Timothy J. Baek
987685dbf9
feat: convo tagging full integration
2024-01-18 02:10:07 -08:00
Timothy J. Baek
d5ed119687
feat: convo tagging api added
2024-01-18 01:04:24 -08:00
Timothy J. Baek
077f1fa34b
feat: convo tagging backend support
2024-01-18 00:58:45 -08:00
Timothy J. Baek
442e3d978a
feat: terminate request on user stop
2024-01-17 19:19:44 -08:00
Marclass
6070e6bcd1
add svelte type to RAG
2024-01-17 20:10:34 -07:00
Marclass
8dacc86ab0
Merge branch 'ollama-webui:main' into main
2024-01-17 16:20:52 -07:00
Timothy Jaeryang Baek
89b35e4556
Merge pull request #504 from mslinn/fix1
...
This script can now be run from any directory
2024-01-17 15:00:24 -08:00
Timothy J. Baek
b6ab357e8c
fix: more edge cases
2024-01-17 14:47:56 -08:00
Mike Slinn
f9885a15e4
Can now run from any directory
2024-01-17 17:30:58 -05:00
Marclass
cf6b3fa48a
remove html type and add js/css
2024-01-17 00:34:22 -07:00
Marclass
43d8466677
feat: Add RAG support for various programming languages
...
Enables RAG for golang, python, java, sh, bat, powershell, cmd, js, css, c/c++/c#, sql, logs, ini, perl, r, dart, docker, env, php, haskell, lua, conf, plsql, ruby, db2, scalla, bash, swift, vue, html, xml, and other arbitrary text files.
2024-01-17 00:09:47 -07:00
Timothy J. Baek
0e039492c6
refac: SERVER_PORT renamed to PORT
2024-01-12 19:38:30 -08:00
Anuraag Jain
a63507c21e
feat: custom port for server
2024-01-11 21:54:14 +02:00
goecho
74f91bc74d
Fix bug: Header attributes (Host, Authorization, Origin, Referer) not sanitized
...
- Resolved an issue where header attributes Host, Authorization, Origin, and Referer were not being sanitized, resulting in two major issues:
1. Ollama requests inadvertently exposed user information, leading to data leakage.
2. When Ollama is deployed on different servers, and the intermediary proxy layer uses the host header to locate downstream services, it fails to find them.
Root Cause:
- In FastAPI, when accessing request.headers, all header names are converted to lowercase. This is because FastAPI, and its underlying framework Starlette, adhere to the HTTP/2 standard, which mandates lowercase header field names for performance and consistency.
- In HTTP/2, enforcing lowercase header field names reduces complexity in header processing as case sensitivity is no longer a concern. Thus, regardless of the case used in client-sent header fields, the server processes them uniformly in lowercase.
- This practice is adopted in FastAPI and other modern HTTP frameworks, even in an HTTP/1.1 context, to maintain consistency with HTTP/2 and improve overall performance. As a result, header field names are always presented in lowercase in FastAPI, even if the original request used capitalization or mixed case.
2024-01-11 14:36:34 +08:00
Timothy J. Baek
ffba59dc3a
Update requirements.txt
2024-01-09 21:09:28 -08:00
Timothy J. Baek
c1ec604f21
feat: rag md support
2024-01-09 15:24:53 -08:00
Timothy J. Baek
76d37393ee
feat: gguf upload
2024-01-09 13:25:42 -08:00
Timothy J. Baek
1ff3eb8038
feat: doc upload error handling
2024-01-08 01:54:03 -08:00
Timothy J. Baek
eddb6fc7b7
feat: documents backend integration
2024-01-08 01:49:20 -08:00
Timothy J. Baek
54c4e0761a
feat: documents file upload
2024-01-08 01:26:15 -08:00
Timothy J. Baek
cc3f84f916
feat: # to import doc
2024-01-07 23:43:32 -08:00
Timothy J. Baek
2603ac30bc
feat: documents
2024-01-07 22:14:08 -08:00
Timothy J. Baek
02f364bfd9
fix: dockerfile
2024-01-07 21:22:37 -08:00
Timothy J. Baek
706a8d4f8d
fix
2024-01-07 21:14:20 -08:00
Timothy J. Baek
162641ee43
Update requirements.txt
2024-01-07 19:54:52 -08:00
Timothy J. Baek
57c050326c
feat: docx support
2024-01-07 13:56:01 -08:00
Timothy J. Baek
9a63376e55
feat: file upload error handling
2024-01-07 09:33:34 -08:00
Timothy J. Baek
b37b157638
feat: reset vectordb storage support
2024-01-07 09:15:45 -08:00
Timothy J. Baek
d4b2578f6e
feat: rag csv support
2024-01-07 09:05:52 -08:00
Timothy J. Baek
d6a1bf1406
refac: file upload
2024-01-07 09:00:30 -08:00
Timothy J. Baek
ffd0a5a2a0
Update main.py
2024-01-07 08:34:05 -08:00
Timothy J. Baek
c68bb3b950
docker: slim
2024-01-07 08:28:35 -08:00
Timothy Jaeryang Baek
34e0f64fb3
Merge pull request #333 from ollama-webui/rag
...
feat: RAG support
2024-01-07 02:50:32 -08:00
Timothy J. Baek
464d0fb016
fix: update langchain.document_loaders
2024-01-07 02:49:13 -08:00
Timothy J. Baek
04db2475f9
fix: disable swagger doc in prod
2024-01-07 02:48:21 -08:00
Timothy J. Baek
70d2571be1
feat: rag backend auth
2024-01-07 02:46:12 -08:00
Timothy J. Baek
c43df8850f
fix: requirements
2024-01-07 02:45:56 -08:00
Timothy J. Baek
142269374f
feat: vectordb query error handling
2024-01-07 01:59:00 -08:00
Timothy J. Baek
ad3d69be30
refac
2024-01-07 01:54:58 -08:00
Timothy J. Baek
9634e2da3e
feat: full integration
2024-01-07 01:40:36 -08:00
Timothy J. Baek
fef4725d56
feat: frontend file upload support
2024-01-07 00:57:10 -08:00
Timothy J. Baek
cd86c36953
feat: pdf data load
2024-01-06 23:40:51 -08:00
Timothy J. Baek
784b369cc9
feat: chromadb vector store api
2024-01-06 22:59:22 -08:00
Timothy J. Baek
b2c9f6dff8
feat: rag api endpoint
2024-01-06 22:07:20 -08:00
Timothy J. Baek
82114c45ee
fix: allow command named create
2024-01-06 17:55:41 -08:00
Timothy Jaeryang Baek
7071716f54
Merge pull request #408 from ollama-webui/main
...
rag
2024-01-06 17:33:52 -08:00
