Commit Graph

2225 Commits

Author SHA1 Message Date
Chloé Daems
175a1cd2dd
Fix/add_megaparse_lib_ (#3476) 2024-11-14 14:09:27 +01:00
Chloé Daems
da97b2cf14
fix: modify megaparse strategy (#3474) 2024-11-12 13:35:41 -08:00
AmineDiro
063bbd323d
fix: added chunk_size in tika processor (#3466) 2024-11-09 15:34:12 +01:00
Chloé Daems
190d971bd7
feat(megaparse): add sdk (#3462)
What it does :

Adds the MegaParse API call for parsing using the SDK
2024-11-08 05:36:54 -08:00
AmineDiro
1356d87098
feat: kms-migration (#3446)
# Description

- necessary changes for Kms v0.1
2024-11-01 08:16:37 -07:00
Stan Girard
6415c75cbd
chore(main): release core 0.0.23 (#3445)
🤖 I have created a release *beep* *boop*
---


##
[0.0.23](https://github.com/QuivrHQ/quivr/compare/core-0.0.22...core-0.0.23)
(2024-10-31)


### Features

* websearch, tool use, user intent, dynamic retrieval, multiple
questions ([#3424](https://github.com/QuivrHQ/quivr/issues/3424))
([285fe5b](285fe5b960))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-31 10:08:42 -07:00
Jacopo Chevallard
285fe5b960
feat: websearch, tool use, user intent, dynamic retrieval, multiple questions (#3424)
# Description

This PR includes far too many new features:

- detection of user intent (closes CORE-211)
- treating multiple questions in parallel (closes CORE-212)
- using the chat history when answering a question (closes CORE-213)
- filtering of retrieved chunks by relevance threshold (closes CORE-217)
- dynamic retrieval of chunks (closes CORE-218)
- enabling web search via Tavily (closes CORE-220)
- enabling agent / assistant to activate tools when relevant to complete
the user task (closes CORE-224)

Also closes CORE-205

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):

---------

Co-authored-by: Stan Girard <stan@quivr.app>
2024-10-31 17:57:54 +01:00
Stan Girard
5401c01ee2
Update README.md 2024-10-24 00:31:03 -07:00
Stan Girard
7c88602516 refactor(docs): Update Quivr documentation structure and content 2024-10-23 15:36:00 +02:00
Jacopo Chevallard
8c7277e9ec
chore: docs on quivr-core workflows (#3420)
# Description

Added some initial documentation on RAG workflows, including also some
nice Excalidraw diagrams

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-23 11:12:23 +02:00
Stan Girard
973c678369 refactor: Update example in README.md 2024-10-21 18:25:45 +02:00
Stan Girard
1c7e75fbd7 refactor: Update example in README.md 2024-10-21 18:25:01 +02:00
Stan Girard
0ecc2775e5 refactor(docs): Update Quivr documentation structure and content 2024-10-21 18:12:54 +02:00
Stan Girard
6391d5ecf4 chore(docs): update launch command in quickstart.md 2024-10-21 17:52:45 +02:00
Stan Girard
fa160aa8ce feat(docs): add search plugin to mkdocs.yml 2024-10-21 17:51:58 +02:00
Stan Girard
e95d48234f fix: Update example in README.md
Updated the example code in the README.md file to create a RAG with 5 lines of code and ask a question about gold in French.
2024-10-21 17:39:44 +02:00
Stan Girard
8a9803d5cb
chore(main): release core 0.0.22 (#3410)
🤖 I have created a release *beep* *boop*
---


##
[0.0.22](https://github.com/QuivrHQ/quivr/compare/core-0.0.21...core-0.0.22)
(2024-10-21)


### Features

* **ask:** non-streaming now calls streaming
([#3409](https://github.com/QuivrHQ/quivr/issues/3409))
([e71e46b](e71e46bcdf))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-21 08:39:12 -07:00
Stan Girard
e71e46bcdf
feat(ask): non-streaming now calls streaming (#3409)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 08:30:34 -07:00
AmineDiro
2b347c96b5
fix : removed megaparse and fix dependencies (#3406)
# Description

- Remove unnecessary  deps
- Fix core tests to unstructured
- Removed megarparse
- Fix examples
2024-10-21 08:03:14 -07:00
Chloé Daems
b606c883d3
fix:add docs on example (#3407)
# Description

This PR just adds examples to the docs
2024-10-21 17:02:38 +02:00
Stan Girard
f816f970f8
feat(docs): Update Quivr README.md (#3408)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 07:55:19 -07:00
Stan Girard
29c279aba2
chore(main): release core 0.0.21 (#3405)
🤖 I have created a release *beep* *boop*
---


##
[0.0.21](https://github.com/QuivrHQ/quivr/compare/core-0.0.20...core-0.0.21)
(2024-10-21)


### Features

* **ci:** trigger
([b92774a](b92774aa37))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-21 05:35:20 -07:00
Stan Girard
b92774aa37 feat(ci): trigger 2024-10-21 14:34:23 +02:00
Stan Girard
20156f44af chore(ci): trigger 2024-10-21 14:33:28 +02:00
Stan Girard
6fd85eb29e feat(changelog): now default method 2024-10-21 14:32:21 +02:00
Stan Girard
6cda54f5c6
fix(rye): workflow (#3404)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 05:28:42 -07:00
Stan Girard
ea4db01218
chore(main): release core 0.0.20 (#3402)
🤖 I have created a release *beep* *boop*
---


##
[0.0.20](https://github.com/QuivrHQ/quivr/compare/core-0.0.19...core-0.0.20)
(2024-10-21)


### Features

* **ci:** trigger
([#3403](https://github.com/QuivrHQ/quivr/issues/3403))
([68c09fc](68c09fce85))
* **docs:** trigger ci
([5644596](5644596725))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-21 05:24:02 -07:00
Stan Girard
68c09fce85
feat(ci): trigger (#3403)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 05:23:15 -07:00
Stan Girard
5644596725 feat(docs): trigger ci 2024-10-21 14:21:48 +02:00
Stan Girard
4e37c6c738 chore(docs): Update license information in core README.md 2024-10-21 10:18:34 +02:00
Stan Girard
e230df9f4b feat(stars): removed 2024-10-21 10:17:21 +02:00
Stan Girard
cd5bc2abc8
chore(docs): incorrect path in .readthedocs.yaml (#3401)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 01:15:18 -07:00
Stan Girard
61f1b621dd chore: Update working directory in release-please-core.yml 2024-10-21 10:10:07 +02:00
Stan Girard
9199493744
chore(main): release core 0.0.19 (#3400)
🤖 I have created a release *beep* *boop*
---


##
[0.0.19](https://github.com/QuivrHQ/quivr/compare/core-0.0.18...core-0.0.19)
(2024-10-21)


### Features

* **quivr-core:** beginning
([#3388](https://github.com/QuivrHQ/quivr/issues/3388))
([7acb52a](7acb52a963))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-21 01:07:17 -07:00
Stan Girard
07a63c6b08
Fix: working directory in release-please-core.yml (#3399)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 01:06:01 -07:00
Stan Girard
7acb52a963
feat(quivr-core): beginning (#3388)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-21 00:50:31 -07:00
Stan Girard
4e96ad86cb
chore(main): release core 0.0.18 (#3385)
🤖 I have created a release *beep* *boop*
---


##
[0.0.18](https://github.com/QuivrHQ/quivr/compare/core-0.0.17...core-0.0.18)
(2024-10-16)


### Bug Fixes

* **core:** megaparse config
([#3384](https://github.com/QuivrHQ/quivr/issues/3384))
([ffe86ca](ffe86ca7ba))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-16 05:55:42 -07:00
Stan Girard
ffe86ca7ba
fix(core): megaparse config (#3384)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-16 05:54:32 -07:00
Stan Girard
16a1863e25
chore(main): release core 0.0.17 (#3221)
🤖 I have created a release *beep* *boop*
---


##
[0.0.17](https://github.com/QuivrHQ/quivr/compare/core-0.0.16...core-0.0.17)
(2024-10-16)


### Features

* **assistant:** cdp
([#3305](https://github.com/QuivrHQ/quivr/issues/3305))
([b767f19](b767f19f28))
* **assistants:** mock api
([#3195](https://github.com/QuivrHQ/quivr/issues/3195))
([282fa0e](282fa0e3f8))
* introducing configurable retrieval workflows
([#3227](https://github.com/QuivrHQ/quivr/issues/3227))
([ef90e8e](ef90e8e672))


### Bug Fixes

* fixing pdf parsing
([#3349](https://github.com/QuivrHQ/quivr/issues/3349))
([367242a](367242a3d5))


### Documentation

* **core:** init ([#3365](https://github.com/QuivrHQ/quivr/issues/3365))
([bb572a2](bb572a2a8d))
* **fix:** fixed warnings from griffe
([#3381](https://github.com/QuivrHQ/quivr/issues/3381))
([1a38798](1a3879839a))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-16 02:52:14 -07:00
Stan Girard
1a3879839a
docs(fix): fixed warnings from griffe (#3381)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-16 02:48:33 -07:00
Stan Girard
029625e322
chore(main): release 0.0.322 (#3352)
🤖 I have created a release *beep* *boop*
---


## 0.0.322 (2024-10-15)

## What's Changed
* feat: Add new documentation files by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3351
* fix: separate english and french ingredients by @chloedia in
https://github.com/QuivrHQ/quivr/pull/3358
* docs(core): init by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3365
* docs: quivr core storage by @AmineDiro in
https://github.com/QuivrHQ/quivr/pull/3366
* fix: fixing pdf parsing by @jacopo-chevallard in
https://github.com/QuivrHQ/quivr/pull/3349
* feat: Improve user credit calculation in get_user_credits by
@StanGirard in https://github.com/QuivrHQ/quivr/pull/3367
* fix unwanted parsing effect by @chloedia in
https://github.com/QuivrHQ/quivr/pull/3371
* add fallback on llamaparse by @chloedia in
https://github.com/QuivrHQ/quivr/pull/3374


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.321...v0.0.322

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-16 01:39:23 -07:00
Chloé Daems
a15c9ec88f
add fallback on llamaparse (#3374)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my code
2024-10-15 01:06:31 -07:00
Chloé Daems
ee9425737e
fix unwanted parsing effect (#3371)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-14 08:23:38 -07:00
Stan Girard
5fc349cd78
feat: Improve user credit calculation in get_user_credits (#3367)
Refactor the get_user_credits method in the Users class to improve the
calculation of monthly chat credits for a user. This change ensures that
the user's monthly chat credit is correctly deducted based on their
usage. If no user settings or monthly chat credit is found, a default
value of 25 is returned.

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-14 06:53:44 -07:00
Jacopo Chevallard
367242a3d5
fix: fixing pdf parsing (#3349)
Our default pdf parser is Unstructured, for which we were using the
'fast' strategy, which fails in parsing some pdf. We instead use the
'auto' strategy which is more flexible and powerful.

Closes TICK-86

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):

---------

Co-authored-by: chloedia <chloedaems0@gmail.com>
2024-10-14 06:21:12 -07:00
AmineDiro
90848eb827
docs: quivr core storage (#3366)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

---------

Co-authored-by: aminediro <aminedirhoussi@gmail.com>
Co-authored-by: Jacopo Chevallard <jacopo.chevallard@mailfence.com>
Co-authored-by: chloedia <chloedaems0@gmail.com>
2024-10-14 01:31:00 -07:00
Stan Girard
bb572a2a8d
docs(core): init (#3365)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):

---------

Co-authored-by: aminediro <aminedirhoussi@gmail.com>
Co-authored-by: Jacopo Chevallard <jacopo.chevallard@mailfence.com>
Co-authored-by: chloedia <chloedaems0@gmail.com>
Co-authored-by: AmineDiro <aminedirhoussi1@gmail.com>
2024-10-11 07:59:03 -07:00
Chloé Daems
6c2858f4db
fix: separate english and french ingredients (#3358)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-10 03:52:42 -07:00
Stan Girard
d6c7735ee1
feat: Add new documentation files (#3351)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-10-09 07:10:54 -07:00
Stan Girard
7b81ae5b8d
chore(main): release 0.0.321 (#3347)
🤖 I have created a release *beep* *boop*
---


## 0.0.321 (2024-10-08)

## What's Changed
* feat: Add file name to knowledge properties in crawl_endpoint by
@StanGirard in https://github.com/QuivrHQ/quivr/pull/3346
* feat(frontend): add xlsx by @Zewed in
https://github.com/QuivrHQ/quivr/pull/3340


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.320...v0.0.321

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-08 07:26:26 -07:00