Stan Girard
1d33fbd3eb
feat(file-system): added queue and filesystem ( #1159 )
...
* feat(queue): added
* feat(crawling): added queue
* fix(crawler): fixed github
* feat(docker): simplified docker compose
* feat(celery): added worker
* feat(files): now uploaded
* feat(files): missing routes
* feat(delete): added
* feat(storage): added policy and migrations
* feat(sqs): implemented
* feat(redis): added queue name variable
* fix(task): updated
* style(env): emoved unused env
* ci(tests): removed broken tests
2023-09-14 11:56:59 +02:00
Mamadou DICKO
9464707d40
feat: merge chat history with chat notifications ( #1127 )
...
* feat: add chat_id to upload and crawl payload
* feat(chat): return chat_history_with_notifications
* feat: explicit notification status on create
* feat: handle notifications in frontend
* feat: delete chat notifications on chat delete request
2023-09-07 17:23:31 +02:00
joelsprunger
a626b84b96
feat(backend): adds python code parsing ( #1003 )
...
Adds a python code parser and invokes it in processors.py
2023-08-22 12:05:31 +02:00
Zineb El Bachiri
3821502c6d
✨ add xlsx and xls parser ( #997 )
2023-08-21 12:56:48 +02:00
Mamadou DICKO
5a3a6fe370
fix: update backend tests ( #992 )
...
* fix: update backend tests
* fix(pytest): update types
2023-08-21 12:45:32 +02:00
MaHDi
8af6d61e76
improve (importing): reorganization of the import structure ( #964 )
...
* reorganize import level
* add __init__, reorganize import from __init__
* reorganize import level
* reorganize import level
* fix circular import error by keep the import deep as "from models.settings"
* fix the relative import
* restor unwanted staged files
* add backend/venv and backend/.env to gitignore
* clean importing
2023-08-21 12:25:16 +02:00
Stan Girard
d0370ab499
feat(refacto): changed a bit of things to make better dx ( #984 )
2023-08-19 13:32:16 +02:00
Matt
e61f437ce8
Feat/backend core ( #656 )
2023-07-17 07:57:27 +01:00
Matt
cef45ea712
Fix: change vector id to UUID ( #609 )
...
* fix: document upload
* feat: explore fix to use uuid id
* chore: remove prints
* fix: tables.sql
2023-07-12 11:44:34 +01:00
Mamadou DICKO
9e9f531c99
Feat/static analysis ( #582 )
...
* feat: add static analysis
* chore: update Makefile add static analysis script
* chore: add vscode extensions recommandations
2023-07-10 14:27:49 +02:00
Zineb El Bachiri
0edc4f628c
🚑 use multithreading instead of multiprocessing for container in ECS ( #525 )
2023-07-05 18:15:18 +02:00
Zineb El Bachiri
01ea71aca8
🐛 send select request supabase in batches with multiprocessing ( #518 )
2023-07-05 14:37:01 +02:00
Matt
e931d29017
feat: new classes ( #499 )
...
* feat: new classes
* chore: private llm refactor and enable streaming
* fix: validation errors in pytest
* fix: default brain behavior
* Update backend/llm/base.py
* chore: remove 🪦
* fix: remove 🪦
2023-07-04 16:56:54 +01:00
Stan Girard
e076bbe79f
Feat/testing backend ( #446 )
...
* feat(pytest): added
* feat(brains): added tests
* feat(actions): pytest
2023-07-02 02:19:30 +02:00
Matt
6f047f4a39
feat: streaming for standard brain picking ( #385 )
...
* feat: streaming for standard brain picking
* fix(bug): private llm
* wip: test
Co-authored-by: Mamadou DICKO <mamadoudicko@users.noreply.github.com>
* wip: almost good
Co-authored-by: Mamadou DICKO <mamadoudicko@users.noreply.github.com>
* feat: useFetch
* chore: remove 💀
* chore: fix linting
* fix: forward the request if not streaming
* feat: streaming for standard brain picking
* fix(bug): private llm
* wip: test
Co-authored-by: Mamadou DICKO <mamadoudicko@users.noreply.github.com>
* wip: almost good
Co-authored-by: Mamadou DICKO <mamadoudicko@users.noreply.github.com>
* feat: useFetch
* chore: remove 💀
* chore: fix linting
* fix: forward the request if not streaming
* fix: 💀 code
* fix: check_user_limit
* feat: brain_id to new chat stream
* fix: missing imports
* feat: message_id created on backend
Co-authored-by: Mamadou DICKO <mamadoudicko@users.noreply.github.com>
* chore: remove dead
* remove: cpython
* remove: dead
---------
Co-authored-by: Mamadou DICKO <mamadoudicko@users.noreply.github.com>
2023-06-30 10:10:59 +02:00
Zineb El Bachiri
4d9bd512ec
Fix/file upload explore ( #412 )
2023-06-29 18:26:03 +02:00
Zineb El Bachiri
ccdc5bb7a7
Feat/multiple brains files ( #361 )
2023-06-28 19:39:27 +02:00
Mamadou DICKO
59fe7b089b
feat(chat): use openai function for answer ( #354 )
...
* feat(chat): use openai function for answer (backend)
* feat(chat): use openai function for answer (frontend)
* chore: refacto BrainPicking
* feat: update chat creation logic
* feat: simplify chat system logic
* feat: set default method to gpt-3.5-turbo-0613
* feat: use user own openai key
* feat(chat): slightly improve prompts
* feat: add global error interceptor
* feat: remove unused endpoints
* docs: update chat system doc
* chore(linter): add unused import remove config
* feat: improve dx
* feat: improve OpenAiFunctionBasedAnswerGenerator prompt
2023-06-22 17:50:06 +02:00
Stan Girard
3d11e3fb51
refactor(brain): removed braintoupdate and added brain ( #356 )
...
* refactor(brain): removed braintoupdate and added brain
* feat(brain): updated
2023-06-21 10:16:44 +02:00
Zineb El Bachiri
9c8e0aa0e4
Feat/multiple brains frontend ( #344 )
...
* 🗑️ remove date input from fetch_user_id_from_credentials
* ♻️ refactor backend utils by splitting it into files
* 💡 comments for next actions to update /upload
* 🚚 move SupabaseProvider tp libs
* 🚚 move useAxios to hooks
* ♻️ refacto brain routes
* 🚨 update lintermfor paths
* ✨ new brain context provider
* ✨ new brain component in navbar
* 🚨 fix linter and async
* 🇸🇪 add feature flag for multiple-brains
2023-06-20 16:17:13 +02:00
Mamadou DICKO
e1a740472f
Feat: chat name edit ( #343 )
...
* feat(chat): add name update
* chore(linting): add flake8
* feat: add chat name edit
2023-06-20 09:54:23 +02:00
Stan Girard
533446a2b4
chore(refacto): removed unused
2023-06-20 00:14:40 +02:00
Stan Girard
99258790ad
refactor(brainpicking): removed one function
2023-06-19 23:14:42 +02:00
Stan Girard
969e0b48a8
refactor(brains): into brainpicking
2023-06-19 22:55:42 +02:00
Stan Girard
72a6ae3dc0
feat(settings): refactored
2023-06-19 22:46:25 +02:00
Stan Girard
b8ec6fd342
refactor(brainsettings): added moved files
2023-06-19 21:21:26 +02:00
Stan Girard
dc6f610b26
feat(neurons): added class
2023-06-19 21:15:35 +02:00
Stan Girard
d42f14f431
feat(brainpicking): new class
2023-06-19 20:51:13 +02:00
Stan Girard
65c44b3fb9
feat(chat): improved chain
2023-06-17 01:16:11 +02:00
Zineb El Bachiri
e53bc6807d
Feat/multiple brains backend ( #340 )
...
* 🗃️ add new tables for multiple brains
* 🗑️ remove date input from fetch_user_id_from_credentials
* ✨ new /brain endpoints
* ♻️ refactor backend utils by splitting it into files
* 💡 comments for next actions to update /upload
2023-06-16 23:36:53 +02:00
Stan Girard
82c74186a8
fix(memory): added memory back
2023-06-15 15:25:12 +02:00
Matt
ec29f30f32
Feat: backend refactor ( #306 )
...
* fix: edge cases on migration scripts
* chore: remove unused deps.
* refactor: user_routes
* refactor: chat_routes
* refactor: upload_routes
* refactor: explore_routes
* refactor: crawl_routes
* chore(refactor): get current user
* refactor: more dead dependencies
* bug: wrap email in credentials dict.
---------
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2023-06-12 17:58:05 +02:00
Zineb El Bachiri
4112699db5
Feat/user chat history ( #275 )
...
* ♻️ refactor backend main routes
* 🗃️ new user_id uuid column in users table
* 🗃️ new chats table
* ✨ new chat endpoints
* ✨ change chat routes post to handle undef chat_id
* ♻️ extract components from chat page
* ✨ add chatId to useQuestion
* ✨ new ChatsList
* ✨ new optional dynamic route chat/{chat_id}
* 🩹 add setQuestion to speach utils
* feat: self supplied key (#286 )
* feat(brain): increased size if api key and more
* fix(key): not displayed
* feat(apikey): now password input
* fix(twitter): handle wrong
* feat(chat): basic source documents support (#289 )
* ♻️ refactor backend main routes
* 🗃️ new user_id uuid column in users table
* 🗃️ new chats table
* ✨ new chat endpoints
* ✨ change chat routes post to handle undef chat_id
* ♻️ extract components from chat page
* ✨ add chatId to useQuestion
* ✨ new ChatsList
* ✨ new optional dynamic route chat/{chat_id}
* 🩹 add setQuestion to speach utils
* 🎨 separate creation and update endpoints for chat
* 🩹 add feat(chat): basic source documents support
* ✨ add chatName upon creation and for chats list
* 💄 improve chatsList style
* User chat history and multiple chats (#290 )
* ♻️ refactor backend main routes
* 🗃️ new user_id uuid column in users table
* 🗃️ new chats table
* ✨ new chat endpoints
* ✨ change chat routes post to handle undef chat_id
* ♻️ extract components from chat page
* ✨ add chatId to useQuestion
* ✨ new ChatsList
* ✨ new optional dynamic route chat/{chat_id}
* refactor(chat): use layout to avoid refetching all chats on every chat
* refactor(chat): useChats hook instead of useQuestion
* fix(chat): fix errors
* refactor(chat): better folder structure
* feat: self supplied key (#286 )
* feat(brain): increased size if api key and more
* fix(key): not displayed
* feat(apikey): now password input
* fix(twitter): handle wrong
* feat(chat): basic source documents support (#289 )
* style(chat): better looking sidebar
* resume merge
* fix(backend): add os and logger imports
* small fixes
* chore(chat): remove empty interface
* chore(chat): use const
* fix(chat): merge errors
* fix(chat): remove useSpeech args
* chore(chat): remove unused args
* fix(chat): remove duplicate components
---------
Co-authored-by: gozineb <zinebe@theodo.fr>
Co-authored-by: Matt <77928207+mattzcarey@users.noreply.github.com>
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
Co-authored-by: xleven <xleven@outlook.com>
* fix and refactor errors
* fix(fresh): installation issues
* chore(conflict): merged old code
* fix(multi-chat): use update endpoint
* feat(embeddings): now using users api key
---------
Co-authored-by: Matt <77928207+mattzcarey@users.noreply.github.com>
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
Co-authored-by: xleven <xleven@outlook.com>
Co-authored-by: Aditya Nandan <61308761+iMADi-ARCH@users.noreply.github.com>
Co-authored-by: iMADi-ARCH <nandanaditya985@gmail.com>
Co-authored-by: Mamadou DICKO <mamadoudicko100@gmail.com>
2023-06-10 23:59:16 +02:00
Stan Girard
5a686a42cb
fix(crawl): added error handling
2023-06-05 17:49:19 +02:00
Stan Girard
a3ca7ecb37
Back/refacto files ( #240 )
...
* feat(docker): added docker for prod
* feat(refacto): moved to modules
2023-06-03 23:12:42 +02:00