Commit Graph

360 Commits

Author SHA1 Message Date
Mamadou DICKO
7480e89fa9
feat: add new brain management page (#1906)
Issue: https://github.com/StanGirard/quivr/issues/1902

Demo:



https://github.com/StanGirard/quivr/assets/63923024/33170c91-3bdc-442a-918a-5013b423f8e5
2023-12-18 14:23:45 +01:00
Zineb El Bachiri
742e9bdfba
feat: chat with compositeBrain ( with/out streaming) (#1883)
# DONE

- generate_stream, generate and save answer in BE

# TODO

- Create an intermediary make_streaming_recursive_tool_calls async
function
- Save intermediary answers in new message logs column then fetch and
display in front
2023-12-15 11:43:41 +01:00
Stan Girard
4fa9a03cc1
feat: Update pytest command in Makefile and add new test (#1893) 2023-12-14 14:20:34 +01:00
Stan Girard
1ffe25eae4
feat: Remove unused method and update file processing (#1890)
logic

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-14 10:31:34 +01:00
Stan Girard
f05951937b feat: Add logger and update file sha1 2023-12-13 23:08:15 +01:00
Stan Girard
f723f8d729 feat: Add logging for brain vector creation 2023-12-13 20:58:13 +01:00
Stan Girard
4a305a854e
feat: Add file URL to DocumentAnswer objects (#1874)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-12 23:16:32 +01:00
Stan Girard
36b008e0eb
feat: Refactor get_question_context_for_brain endpoint (#1872)
to return a list of DocumentAnswer objects

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-12 22:33:23 +01:00
Stan Girard
1a2af91eef feat(premium): increased max size 2023-12-11 17:43:30 +01:00
Mamadou DICKO
512b9b4f37
feat: add custom rag first abstraction layer (#1858)
- Add `QAInterface` which should be implemented by all custom answer
generator to be compatible with Quivr
- Add `RAGInterface` which should be implemented by all RAG classes
2023-12-11 16:46:45 +01:00
Mamadou DICKO
7e6209a30b
feat: add generate_answer function to support non streamed response for api brain (#1847)
Issue: https://github.com/StanGirard/quivr/issues/1841

Demo:


https://github.com/StanGirard/quivr/assets/63923024/56dfa85c-6c2e-4e55-8eda-4723e58ced1d
2023-12-07 14:52:37 +01:00
Zineb El Bachiri
90c4a44525
feat: composite brains get (#1837)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-06 15:44:36 +01:00
Stan Girard
5619f2e602 feat(sentry): added on celery 2023-12-06 12:20:46 +01:00
Zineb El Bachiri
5bbc72eb09
feat: composite brains db (#1826)
# Description

- db for composite brains & repository
- composite brains creation
2023-12-06 08:40:18 +01:00
Stan Girard
8ba376e0a1
feat(requirements): update aws version (#1819)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-05 13:49:34 +01:00
Yon
5f23bcfcb8
fix: celery config typo (#1776)
# Description

There was a typo on one of the celery's config variables.
The `CELEBRY_BROKER_QUEUE_NAME` variable has been replaced by
`CELERY_BROKER_QUEUE_NAME`

## Checklist before requesting a review

Please delete options that are not relevant.

- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my code
2023-12-05 09:40:40 +01:00
Stan Girard
b8f8851ccd feat(docker): multi platform build and prebuilt 2023-12-05 00:10:49 +01:00
Stan Girard
d0d74cecbb chore(ci): trigger it 2023-12-05 00:02:48 +01:00
Zineb El Bachiri
436e49a5e7
refactor: chat for multibrains (#1812)
# Description

- Chat Module
- External Api Secrets Interface, exposed through brain service
2023-12-04 18:38:54 +01:00
Stan Girard
ef53590b58
feat(embedding): now 100 times faster 🔥 (#1807)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-04 11:59:08 +01:00
Stan Girard
31c1802084
feat(api-keys): added customization (#1802)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-03 23:32:37 +01:00
Stan Girard
4c89812832 feat(supabase): upgraded to latest version 2023-12-03 20:26:26 +01:00
Stan Girard
a5ef5a0454 fix(supabase): fixed 2023-12-03 01:35:01 +01:00
Stan Girard
882a10c459 fix(prompt): fixed issue with wrong api key 2023-12-03 01:22:38 +01:00
Stan Girard
c82a8cc8b1
fix(url): crawling fixed (#1785)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-02 18:08:22 +01:00
Stan Girard
9e0bc0749f
feat: 🎸 install (#1784)
now made easy

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-02 14:50:57 +01:00
Stan Girard
72aaec2a1b
feat(supabase): local installation made easy (#1777)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-12-01 19:43:23 +01:00
Stan Girard
c0f8f50c49 feat(telemetry): implmented local telemetry for local runs 2023-12-01 17:02:46 +01:00
Zineb El Bachiri
f48dab4a7d
refactor: to modules (#1754)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-30 22:29:28 +01:00
Stan Girard
a84219f193
fix(api): fixed issue with name function and ilmproved promtp (#1759)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-29 23:54:39 +01:00
Stan Girard
e1cde0fcb4
Feat/local llm bug fix (#1758)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-29 19:17:16 +01:00
Mamadou DICKO
07618877a9
fix: revert implement local llms (#1749) 2023-11-29 13:19:22 +01:00
Mamadou DICKO
d5b45cbad1
chore: downgrade versions (#1748) 2023-11-29 13:18:52 +01:00
Zineb El Bachiri
9766befb53
refactor: knowledge module (#1743)
# Description

- Refactor knowledge to a module

- This PR breaks the Github Processor function -> need to comment brain
and file imports as it creates a circular dependency issue. Should be
fixed and reverted in next PR.
2023-11-29 09:04:03 +01:00
Stan Girard
7e4f711f07
feat: implement local llms (#1745)
upgraded

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-29 00:07:04 +01:00
Zineb El Bachiri
9858a484a1
refactor: remove explore route from back & front (#1741)
# Description

- Removes the explore route from back & front as it has been replaced by
the knowledge route
2023-11-28 14:28:05 +01:00
Zineb El Bachiri
0782df5e37
refactor: Notification module (#1740)
# Description

- Notification module

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-28 14:27:39 +01:00
Stan Girard
928e6b6ab2 chore(sentry): sampling 2023-11-28 08:46:42 +01:00
Stan Girard
7ff081cf40
fix: 🐛 crawler (#1735)
fixed

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-27 17:36:46 +01:00
Mamadou DICKO
10e94e5a91
feat: improve delete knowledge performance (#1733)
Issue: https://github.com/StanGirard/quivr/issues/1724
2023-11-27 16:47:13 +01:00
Mamadou DICKO
f1ddaca7e2
feat(publicBrains): use join queries for better performance (#1730)
Issue https://github.com/StanGirard/quivr/issues/1720
2023-11-27 14:16:27 +01:00
Mamadou DICKO
b252aa1794
fix: update max token logic (#1725)
Fix headless and Doc based brains max token overwriting
2023-11-27 11:21:26 +01:00
Stan Girard
56a5c81fe4
fix: 🐛 sentry (#1716)
reduce sampling

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-27 10:08:00 +01:00
Stan Girard
e3a6f86d7b fix: 🐛 upload
wrong ctrl f replace
2023-11-24 23:12:49 +01:00
Stan Girard
3ffe6a8d5a chore: 🤖 sentry
reduce sampling
2023-11-24 23:12:18 +01:00
Mamadou DICKO
65e656f04e
feat: add api brain steps log (backend) (#1705)
Issue https://github.com/StanGirard/quivr/issues/1697
2023-11-24 14:58:33 +01:00
Mamadou DICKO
65a4057272
feat: display notification when file size is too big (#1704)
Issue: 

https://github.com/StanGirard/quivr/issues/1703

Demo:


https://github.com/StanGirard/quivr/assets/63923024/76c9a294-ff0b-4d38-8683-2fefb710fd48
2023-11-24 14:54:16 +01:00
Stan Girard
a5518e6b2a chore(sentry): smaller sampling rate 2023-11-24 14:46:25 +01:00
Zineb El Bachiri
f578b2fa00
refactor: onboarding module (#1702)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2023-11-24 10:25:02 +01:00
Mamadou DICKO
4bb1a0dc8a
fix: update max token overwrite logic (#1694)
Issue: https://github.com/StanGirard/quivr/issues/1690
2023-11-23 17:36:11 +01:00