Commit Graph

360 Commits

Author SHA1 Message Date
Stan Girard
17aaf18d61 feat(vectorstore): own folder 2023-06-19 20:15:34 +02:00
Stan Girard
954acf1286 fix(llm): changed to stuff 2023-06-19 17:53:07 +02:00
Stan Girard
225280f2f5 fix(doc): retrieval to 8 because it takes a long time 2023-06-19 11:23:58 +02:00
Stan Girard
c0ff030100 feat(k): increased to 16 2023-06-17 01:32:03 +02:00
Stan Girard
65c44b3fb9 feat(chat): improved chain 2023-06-17 01:16:11 +02:00
Zineb El Bachiri
e53bc6807d
Feat/multiple brains backend (#340)
* 🗃️ add new tables for multiple brains

* 🗑️ remove date input from fetch_user_id_from_credentials

*  new /brain endpoints

* ♻️ refactor backend utils by splitting it into files

* 💡 comments for next actions to update /upload
2023-06-16 23:36:53 +02:00
Stan Girard
f833de47bc feat(openai): 16k 2023-06-16 17:52:32 +02:00
Stan Girard
82c74186a8 fix(memory): added memory back 2023-06-15 15:25:12 +02:00
Ruben1701
8fb245fe2a
Improved api docs (#336)
* auyto removed

* updated the api docs

* fixed missing logic in api_key_route + chat_route

* Update settings.json

---------

Co-authored-by: Ruben170 <35116541+Ruben170@users.noreply.github.com>
2023-06-15 14:43:40 +02:00
Stan Girard
9af6a250e3 fix(model): broke something yesterday in QA 2023-06-14 22:23:05 +02:00
Stan Girard
f4e85db187 fix(llm): using wrong llm probably because of breaking change in langchain 2023-06-14 22:15:48 +02:00
Cezar Vasconcelos
3b7390dd61
Feat/add new openai llm models (#334)
* feat(frontend): update OpenAi models and maxToken select's

* fix: update openai model to use the most recent

* fix: adjust max token for gpt-3 turbo

* fix: duplicating models

* fix: openai model type list
2023-06-14 21:30:52 +02:00
Matt
33f49ee289
feat: user can create api keys (#329)
* feat: user can create api keys

* fix: linting on build

* Update backend/routes/api_key_routes.py

* chore: rename and refactor AuthBearer

* chore: add types
2023-06-14 21:21:13 +02:00
Arthur Busser
4546e8bc1d
Improve the prompt sent to the LLM (#318)
This is a more detailed prompt that explains what Quivr is and what it
does.
2023-06-13 16:24:07 +02:00
Stan Girard
de8daa04bf fix(prompt): less picky 2023-06-13 14:43:53 +02:00
Stan Girard
6708a7860a fix(prompt): added prompt qa to anthropic 2023-06-13 11:00:15 +02:00
Stan Girard
ab7dfbbaec fix(prompt): condense prompt 2023-06-13 10:59:24 +02:00
Stan Girard
9f0ba8bce7 fix(prompt): fixed qa prompt 2023-06-13 10:35:06 +02:00
Matt
ec29f30f32
Feat: backend refactor (#306)
* fix: edge cases on migration scripts

* chore: remove unused deps.

* refactor: user_routes

* refactor: chat_routes

* refactor: upload_routes

* refactor: explore_routes

* refactor: crawl_routes

* chore(refactor): get current user

* refactor: more dead dependencies

* bug: wrap email in credentials dict.

---------

Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2023-06-12 17:58:05 +02:00
Stan Girard
67530c13f2 fix(google): requirements 2023-06-12 17:37:58 +02:00
Stan Girard
44d067d28d fix(crawl): github 2023-06-11 00:30:19 +02:00
Zineb El Bachiri
4112699db5
Feat/user chat history (#275)
* ♻️ refactor backend main routes

* 🗃️ new user_id uuid column in users table

* 🗃️ new chats table

*  new chat endpoints

*  change chat routes post to handle undef chat_id

* ♻️ extract components from chat page

*  add chatId to useQuestion

*  new ChatsList

*  new optional dynamic route chat/{chat_id}

* 🩹 add setQuestion to speach utils

* feat: self supplied key (#286)

* feat(brain): increased size if api key and more

* fix(key): not displayed

* feat(apikey): now password input

* fix(twitter): handle wrong

* feat(chat): basic source documents support (#289)

* ♻️ refactor backend main routes

* 🗃️ new user_id uuid column in users table

* 🗃️ new chats table

*  new chat endpoints

*  change chat routes post to handle undef chat_id

* ♻️ extract components from chat page

*  add chatId to useQuestion

*  new ChatsList

*  new optional dynamic route chat/{chat_id}

* 🩹 add setQuestion to speach utils

* 🎨 separate creation and update endpoints for chat

* 🩹 add feat(chat): basic source documents support

*  add chatName upon creation and for chats list

* 💄 improve chatsList style

* User chat history and multiple chats (#290)

* ♻️ refactor backend main routes

* 🗃️ new user_id uuid column in users table

* 🗃️ new chats table

*  new chat endpoints

*  change chat routes post to handle undef chat_id

* ♻️ extract components from chat page

*  add chatId to useQuestion

*  new ChatsList

*  new optional dynamic route chat/{chat_id}

* refactor(chat): use layout to avoid refetching all chats on every chat

* refactor(chat): useChats hook instead of useQuestion

* fix(chat): fix errors

* refactor(chat): better folder structure

* feat: self supplied key (#286)

* feat(brain): increased size if api key and more

* fix(key): not displayed

* feat(apikey): now password input

* fix(twitter): handle wrong

* feat(chat): basic source documents support (#289)

* style(chat): better looking sidebar

* resume merge

* fix(backend): add os and logger imports

* small fixes

* chore(chat): remove empty interface

* chore(chat): use const

* fix(chat): merge errors

* fix(chat): remove useSpeech args

* chore(chat): remove unused args

* fix(chat): remove duplicate components

---------

Co-authored-by: gozineb <zinebe@theodo.fr>
Co-authored-by: Matt <77928207+mattzcarey@users.noreply.github.com>
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
Co-authored-by: xleven <xleven@outlook.com>

* fix and refactor errors

* fix(fresh): installation issues

* chore(conflict): merged old code

* fix(multi-chat): use update endpoint

* feat(embeddings): now using users api key

---------

Co-authored-by: Matt <77928207+mattzcarey@users.noreply.github.com>
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
Co-authored-by: xleven <xleven@outlook.com>
Co-authored-by: Aditya Nandan <61308761+iMADi-ARCH@users.noreply.github.com>
Co-authored-by: iMADi-ARCH <nandanaditya985@gmail.com>
Co-authored-by: Mamadou DICKO <mamadoudicko100@gmail.com>
2023-06-10 23:59:16 +02:00
xleven
5a0f8326df
feat(chat): basic source documents support (#289) 2023-06-10 10:43:44 +02:00
Stan Girard
399a3fe437 feat(brain): increased size if api key and more 2023-06-09 23:20:51 +02:00
Matt
a64df04eab
feat: self supplied key (#286) 2023-06-09 18:49:47 +02:00
Stan Girard
e0cf37791b feat(pdf): added new pdf miner that works 2023-06-06 11:18:33 +02:00
Stan Girard
963fb05682
feat(github): now github loader (#264) 2023-06-06 00:38:15 +02:00
Stan Girard
90b2393b26 fix(zineb): she broke everything 2023-06-05 18:26:23 +02:00
Zineb El Bachiri
a5c71be731
Feat/user page (#255)
*  new backend get /user endpoint

*  new user page for statistics

* 📦 add @mui/material & its dependencies
📦 add prettyBytes package

* 🌱 new UserStatistics component for user page

* 🏷️ use RequestStat type for requests_stats

*  new brainConsumption component

*  new Date component

* 📦 add  date-fns, victory

*  requests per day chart

*  full UserStatistics component

*  put UserStatistics in Card in user's page
2023-06-05 17:58:59 +02:00
Stan Girard
5a686a42cb fix(crawl): added error handling 2023-06-05 17:49:19 +02:00
Lecky Lao
fbae9016e2
fix(parser): process audio wrong argument (#243) 2023-06-04 11:53:49 +02:00
Stan Girard
a3ca7ecb37
Back/refacto files (#240)
* feat(docker): added docker for prod

* feat(refacto): moved to modules
2023-06-03 23:12:42 +02:00
Stan Girard
f2164db12c feat(cors): fix 2023-06-03 19:17:48 +02:00
Stan Girard
5323d93dc1 feat(api): cors 2023-06-03 19:07:50 +02:00
Stan Girard
ce11a9d54a feat(cors): changed to production value 2023-06-02 11:15:12 +02:00
Zineb El Bachiri
c3bb0257f0
Feat/rate limiter (#222)
* 🔧 new use rate limiting env variables

* 🗃️ new Users table for rate limiting

* limit user's requests number per day

*  limit user's brain size

* docs(readme): updated with new migration

---------

Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2023-06-01 22:51:39 +02:00
Stan Girard
72c92b1a54
VertexAI Google Cloud Palm2 Support (#226)
* feat(bard): added

* docs(readme): update

* chore(print): removed
2023-06-01 16:01:27 +02:00
Stan Girard
e0de23e24d
Feat/single brain (#215)
* feat(llm): update

* feat(singlebrain): added new table with user-id

* feat(user): get user from email

* feat(user_id): added search

*  add user_id to most endpoints

* docs(readme): new script

---------

Co-authored-by: gozineb <zinebe@theodo.fr>
2023-05-31 13:51:23 +02:00
Zineb El Bachiri
cc6ec8fee9
new ODT document loader (#211) 2023-05-30 13:02:48 +02:00
Stan Girard
e11183ed07 chore(binary): removed 2023-05-26 08:11:34 +02:00
Shan
7adcdd3d51
Support for capitalized file extensions such as PDF (#146) 2023-05-25 23:58:38 +02:00
Stan Girard
327074c5d4
feat(auth): now application has authentication (#144)
* feat(auth): backend authentification verification

* feat(auth): added to all endpoints

* feat(auth): added to all endpoints

* feat(auth): redirect if not connected

* chore(print): removed

* feat(login): redirect

* feat(icon): added

* chore(yarn): removed lock

* chore(gitignore): removed
2023-05-24 22:21:22 +02:00
Stan Girard
4bdba525ca docs(readme): updated frontend 2023-05-24 16:43:26 +02:00
Stan Girard
f7e237905f
Feat auth (#142)
* feat(supabase): added auth

* feat(auth): working for front

* fix(auth): now front can build

* feat(auth): nice screen
2023-05-24 16:17:08 +02:00
Stan Girard
363528d2ce fix(cors): allow all origins 2023-05-22 15:18:25 +02:00
shaun
ec6f7332b9 make it optional 2023-05-22 00:12:46 -07:00
shaun
a52fcbe684 add missing column 2023-05-21 23:59:06 -07:00
shaun
389a70199a fix message 2023-05-21 23:56:11 -07:00
shaun
c38265a5f5 add summarization backend 2023-05-21 23:39:55 -07:00
shaun
a1693d94b2 Better envs 2023-05-21 21:18:55 -07:00
Murtaza
514f3b352a Add support for jupyter notebooks. 2023-05-22 00:42:41 +05:30
Stan Girard
70a70d0c17
Merge pull request #109 from dheerapat/fix-dockerfile-pip
set pip timeout to 100 second (default 15)
2023-05-21 18:54:51 +02:00
Stan Girard
56ba503cdf
url upload (#108)
* feat(url): input area

* feat(upload): added cards next to each other

* feat(typing): typed urlinput
2023-05-21 18:50:58 +02:00
Dheerapat Tookkane
020c41b986 set pip timeout to 100 second (default 15) 2023-05-21 23:11:00 +07:00
Stan Girard
d869f642c6
Merge branch 'main' into main 2023-05-21 16:21:34 +02:00
Valerie
a7089ae5bc support other prompt languages in new backend 2023-05-21 16:01:53 +02:00
Stan Girard
97bf4464ad
Merge branch 'main' into main 2023-05-21 09:34:31 +02:00
Evan Carlson
6dab1259ef
add docx2txt package for uploading word docs (#93) 2023-05-21 09:21:51 +02:00
Murtaza
1706538343 Add epub loader to parse epub uploads. 2023-05-21 11:45:31 +05:30
Stan Girard
f952d7a269
New Webapp migration (#56)
* feat(v2): loaders added

* feature: Add scroll animations

* feature: upload ui

* feature: upload multiple files

* fix: Same file name and size remove

* feat(crawler): added

* feat(parsers): v2 added more

* feat(v2): audio now working

* feat(v2): all loaders

* feat(v2): explorer

* chore: add links

* feat(api): added status in return message

* refactor(website): remove old code

* feat(upload): return type for messages

* feature: redirect to upload if ENV=local

* fix(chat): fixed some issues

* feature: respect response type

* loading state

* feature: Loading stat

* feat(v2): added explore and chat pages

* feature: modal settings

* style: Chat UI

* feature: scroll to bottom when chatting

* feature: smooth scroll in chat

* feature(anim): Slide chat in

* feature: markdown chat

* feat(explorer): list

* feat(doc): added document item

* feat(explore): added modal

* Add clarification on Project API keys and web interface for migration scripts to Readme (#58)

* fix(demo): changed link

* add support to uploading zip file (#62)

* Catch UnicodeEncodeError exception (#64)

* feature: fixed chatbar

* fix(loaders): missing argument

* fix: layout

* fix: One whole chatbox

* fix: Scroll into view

* fix(build): vercel issues

* chore(streamlit): moved to own file

* refactor(api): moved to backend folder

* feat(docker): added docker compose

* Fix a bug where langchain memories were not being cleaned (#71)

* Update README.md (#70)

* chore(streamlit): moved to own file

* refactor(api): moved to backend folder

* docs(readme): updated for new version

* docs(readme): added old readme

* docs(readme): update copy dot env file

* docs(readme): cleanup

---------

Co-authored-by: iMADi-ARCH <nandanaditya985@gmail.com>
Co-authored-by: Matt LeBel <github@lebel.io>
Co-authored-by: Evan Carlson <45178375+EvanCarlson@users.noreply.github.com>
Co-authored-by: Mustafa Hasan Khan <65130881+mustafahasankhan@users.noreply.github.com>
Co-authored-by: zhulixi <48713110+zlxxlz1026@users.noreply.github.com>
Co-authored-by: Stanisław Tuszyński <stanislaw@tuszynski.me>
2023-05-21 01:20:55 +02:00