Commit Graph

2135 Commits

Author SHA1 Message Date
Jacopo Chevallard
1456015c68
fix: wrong default path for CHAT_LLM_CONFIG_PATH env variable (#3247)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-23 10:15:07 -07:00
Jacopo Chevallard
ef90e8e672
feat: introducing configurable retrieval workflows (#3227)
# Description

Major PR which, among other things, introduces the possibility of easily
customizing the retrieval workflows. Workflows are based on LangGraph,
and can be customized using a [yaml configuration
file](core/tests/test_llm_endpoint.py), and adding the implementation of
the nodes logic into
[quivr_rag_langgraph.py](1a0c98437a/backend/core/quivr_core/quivr_rag_langgraph.py)

This is a first, simple implementation that will significantly evolve in
the coming weeks to enable more complex workflows (for instance, with
conditional nodes). We also plan to adopt a similar approach for the
ingestion part, i.e. to enable user to easily customize the ingestion
pipeline.

Closes CORE-195, CORE-203, CORE-204

## Checklist before requesting a review

Please delete options that are not relevant.

- [X] My code follows the style guidelines of this project
- [X] I have performed a self-review of my code
- [X] I have commented hard-to-understand areas
- [X] I have ideally added tests that prove my fix is effective or that
my feature works
- [X] New and existing unit tests pass locally with my changes
- [X] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-23 09:11:06 -07:00
AmineDiro
5e48594c77
feat: remove n+1 query knowledge (#3238)
# Description

closes #3237
2024-09-23 02:41:35 -07:00
Stan Girard
ad87641d19
fix(migration): order migrations (#3231)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-19 06:21:33 -07:00
Chloé Daems
42f4bb724e
feat(integration): Notion (#3173)
# Description

Fix multiple notion bugs 👍 

-> Delete your notion sync and all the notion files from the db
-> Ensure a sync is not already running before launching a sync.
-> Add a status to subscribe to for user_sync

---------

Co-authored-by: Antoine Dewez <44063631+Zewed@users.noreply.github.com>
Co-authored-by: Stan Girard <stan@quivr.app>
Co-authored-by: aminediro <aminedirhoussi1@gmail.com>
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2024-09-19 05:37:04 -07:00
Stan Girard
9c6d998c7c
chore(examples): fix chainlit example (#3223)
The commit updates the message content in the `main.py` file of the
chatbot example.

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-18 08:12:24 -07:00
Stan Girard
282fa0e3f8
feat(assistants): mock api (#3195)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-18 03:30:48 -07:00
Stan Girard
4390d318a2
chore(main): release core 0.0.16 (#3218)
🤖 I have created a release *beep* *boop*
---


##
[0.0.16](https://github.com/QuivrHQ/quivr/compare/core-0.0.15...core-0.0.16)
(2024-09-17)


### Bug Fixes

* **core:** enforce langchain &lt;0.3 for pydantic v1
([#3217](https://github.com/QuivrHQ/quivr/issues/3217))
([4bb4800](4bb4800a76))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-17 15:18:00 -07:00
Stan Girard
4bb4800a76
fix(core): enforce langchain <0.3 for pydantic v1 (#3217)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-17 15:17:11 -07:00
Stan Girard
9063b10132
chore(main): release 0.0.315 (#3212)
🤖 I have created a release *beep* *boop*
---


## 0.0.315 (2024-09-17)

## What's Changed
* chore(main): release core 0.0.15 by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3203
* fix: knowledge user_id fix by @AmineDiro in
https://github.com/QuivrHQ/quivr/pull/3216


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.314...v0.0.315

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-17 13:57:24 -07:00
AmineDiro
6a0dbfe833
fix: knowledge user_id fix (#3216) 2024-09-17 19:06:04 +02:00
Stan Girard
348c1a71b0
chore(main): release core 0.0.15 (#3203)
🤖 I have created a release *beep* *boop*
---


##
[0.0.15](https://github.com/QuivrHQ/quivr/compare/core-0.0.14...core-0.0.15)
(2024-09-16)


### Features

* CRUD KMS (no syncs)
([#3162](https://github.com/QuivrHQ/quivr/issues/3162))
([71edca5](71edca572f))
* save and load brain
([#3202](https://github.com/QuivrHQ/quivr/issues/3202))
([eda619f](eda619f454))


### Bug Fixes

* Update LLMEndpoint to include max_tokens parameter
([#3201](https://github.com/QuivrHQ/quivr/issues/3201))
([13ed225](13ed225b17))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-16 05:54:29 -07:00
Stan Girard
1c60a9f538
chore(main): release 0.0.314 (#3210)
🤖 I have created a release *beep* *boop*
---


## 0.0.314 (2024-09-16)

## What's Changed
* feat: CRUD KMS (no syncs) by @AmineDiro in
https://github.com/QuivrHQ/quivr/pull/3162


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.313...v0.0.314

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-16 05:52:15 -07:00
AmineDiro
71edca572f
feat: CRUD KMS (no syncs) (#3162)
# Description

closes #3056.
closes #3198 


- Create knowledge route
- Get knowledge route
- List knowledge route : accepts knowledge_id | None. None to list root
knowledge for use
- Update (patch) knowledge to rename and move knowledge
- Remove knowledge: Cascade if parent_id in knowledge and cleanup
storage
- Link storage upload to knowledge_service
- Relax sha1 file constraint
- Tests to all repository / service

---------

Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2024-09-16 04:31:09 -07:00
Stan Girard
edc4118ba1
chore(main): release 0.0.313 (#3205)
🤖 I have created a release *beep* *boop*
---


## 0.0.313 (2024-09-13)

## What's Changed
* feat: save and load brain by @AmineDiro in
https://github.com/QuivrHQ/quivr/pull/3202


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.312...v0.0.313

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-15 03:05:28 -07:00
AmineDiro
eda619f454
feat: save and load brain (#3202)
# Description
- Save and load brain to disk: 
```python
async def main():
    with tempfile.NamedTemporaryFile(mode="w", suffix=".txt") as temp_file:
        temp_file.write("Gold is a liquid of blue-like colour.")
        temp_file.flush()

        brain = await Brain.afrom_files(name="test_brain", file_paths=[temp_file.name])

        save_path = await brain.save("/home/amine/.local/quivr")

        brain_loaded = Brain.load(save_path)
        brain_loaded.print_info()

```

# TODO: 
- Loading all chat history
- Loading from other vector stores, PG for example can be great ...
2024-09-13 06:35:28 -07:00
Stan Girard
06f72eb451
chore(main): release 0.0.312 (#3204)
🤖 I have created a release *beep* *boop*
---


## 0.0.312 (2024-09-13)

## What's Changed
* fix: Update LLMEndpoint to include max_tokens parameter by @StanGirard
in https://github.com/QuivrHQ/quivr/pull/3201


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.311...v0.0.312

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-13 02:17:28 -07:00
Stan Girard
13ed225b17
fix: Update LLMEndpoint to include max_tokens parameter (#3201)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-13 01:59:41 -07:00
Stan Girard
8fb4887716
chore(main): release 0.0.311 (#3194)
🤖 I have created a release *beep* *boop*
---


## 0.0.311 (2024-09-12)

## What's Changed
* chore(embeddings): added tests for embeddings by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3183
* feat(uptime): check if connection to db works by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3199


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.310...v0.0.311

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-12 09:42:00 -07:00
Stan Girard
d9b0e62618
feat(uptime): check if connection to db works (#3199)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-12 08:22:24 -07:00
Stan Girard
758e87e89c
chore(embeddings): added tests for embeddings (#3183)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-11 07:00:19 -07:00
Stan Girard
7edc3a2e4a
chore(main): release 0.0.310 (#3181)
🤖 I have created a release *beep* *boop*
---


## 0.0.310 (2024-09-10)

## What's Changed
* feat: Add Azure OpenAI embeddings support by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3182


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.309...v0.0.310

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-11 06:58:58 -07:00
Stan Girard
452f09280d
feat: Add Azure OpenAI embeddings support (#3182)
The code changes in `dependencies.py` add support for Azure OpenAI
embeddings by parsing the provided URL and extracting the deployment
name, endpoint, and API version. This allows the application to use
Azure OpenAI embeddings for language processing.

Note: The recent user commits and repository commits are not directly
related to the code changes in `dependencies.py` and are not considered
for the commit message.

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-10 09:44:22 -07:00
Stan Girard
fb0658a43d fix(docker): compose 2024-09-10 18:13:16 +02:00
Stan Girard
d6262f0812
chore(main): release 0.0.309 (#3171)
🤖 I have created a release *beep* *boop*
---


## 0.0.309 (2024-09-10)

## What's Changed
* chore: Add initial documentation files and configuration by
@StanGirard in https://github.com/QuivrHQ/quivr/pull/3126
* chore: Add .readthedocs.yaml configuration file by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3172
* fix(frontend): notion integration in front end by @Zewed in
https://github.com/QuivrHQ/quivr/pull/3175
* chore(main): release core 0.0.14 by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2945
* ci(rye): now core is built with rye by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3177
* feat: Add external Supabase URL support for generating file signed URL
by @StanGirard in https://github.com/QuivrHQ/quivr/pull/3179
* fix(onboarding): keeps setting it at false by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/3180


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.308...v0.0.309

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-10 08:53:34 -07:00
Stan Girard
36e5991329
fix(onboarding): keeps setting it at false (#3180)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-10 08:46:00 -07:00
Stan Girard
9cbb47f75a
feat: Add external Supabase URL support for generating file signed URL (#3179)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-10 07:53:44 -07:00
Stan Girard
9e18514c37
ci(rye): now core is built with rye (#3177)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-10 02:11:35 -07:00
Stan Girard
22567c8767 ci: rye update ci 2024-09-10 11:07:59 +02:00
Stan Girard
fba181077f
chore(main): release core 0.0.14 (#2945)
🤖 I have created a release *beep* *boop*
---


##
[0.0.14](https://github.com/QuivrHQ/quivr/compare/core-0.0.13...core-0.0.14)
(2024-09-09)


### Features

* Add brain_id and brain_name to ChatLLMMetadata model
([#2968](https://github.com/QuivrHQ/quivr/issues/2968))
([1112001](111200184b))
* add chat with models
([#2933](https://github.com/QuivrHQ/quivr/issues/2933))
([fccd197](fccd197511))
* Add get_model method to ModelRepository
([#2949](https://github.com/QuivrHQ/quivr/issues/2949))
([13e9fc4](13e9fc490b))
* **anthropic:** add llm
([#3146](https://github.com/QuivrHQ/quivr/issues/3146))
([8e29218](8e29218865))
* **azure:** quivr compatible with it
([#3005](https://github.com/QuivrHQ/quivr/issues/3005))
([b5f31a8](b5f31a83d4))
* **frontend:** talk with models and handle code markdown
([#2980](https://github.com/QuivrHQ/quivr/issues/2980))
([ef6037e](ef6037e665))
* quivr core 0.1 ([#2970](https://github.com/QuivrHQ/quivr/issues/2970))
([380cf82](380cf82706))
* using langgraph in our RAG pipeline
([#3130](https://github.com/QuivrHQ/quivr/issues/3130))
([8cfdf53](8cfdf53fe7))


### Bug Fixes

* **chat:** order of chat history was reversed
([#3148](https://github.com/QuivrHQ/quivr/issues/3148))
([7209500](7209500d0b))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-10 02:00:39 -07:00
Antoine Dewez
4c7dedce80
fix(frontend): notion integration in front end (#3175)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-09 14:27:22 +02:00
Stan Girard
69e2f1be34 chore: Update .readthedocs.yaml configuration file to include backend path 2024-09-09 13:56:31 +02:00
Stan Girard
7e67a6674d chore: Update .readthedocs.yaml configuration file to include backend path 2024-09-09 13:55:09 +02:00
Stan Girard
0cc006f4e7 chore: Update .readthedocs.yaml configuration file to include backend path 2024-09-09 13:48:31 +02:00
Stan Girard
afbc92817b chore: Update .readthedocs.yaml configuration file to include backend path 2024-09-09 13:47:49 +02:00
Stan Girard
732d3a6699 chore: Update .readthedocs.yaml configuration file to include backend path 2024-09-09 13:42:24 +02:00
Stan Girard
baaee46d83 chore: Update .readthedocs.yaml configuration file to include backend path 2024-09-09 12:33:34 +02:00
Stan Girard
31a9885c3f chore: Update .readthedocs.yaml configuration file and add backend path 2024-09-09 12:25:56 +02:00
Stan Girard
7eb50781b0 chore: Update .readthedocs.yaml configuration file and add backend path 2024-09-09 12:24:51 +02:00
Stan Girard
e1127a861f chore: Update .readthedocs.yaml configuration file and add backend path 2024-09-09 12:23:47 +02:00
Stan Girard
dafcb9cfde chore: Update .readthedocs.yaml configuration file and add backend path 2024-09-09 11:59:55 +02:00
Stan Girard
34178a74c5 chore: Update .readthedocs.yaml configuration file and add backend path 2024-09-09 11:50:59 +02:00
Stan Girard
5009882589 chore: Update .readthedocs.yaml configuration file 2024-09-09 11:46:54 +02:00
Stan Girard
317325c1a9 chore: Add empty file for backend documentation overrides 2024-09-09 11:37:43 +02:00
Stan Girard
af6db28d80 chore: Update pyproject.toml with venv and basedpyright configuration 2024-09-09 11:35:50 +02:00
Stan Girard
2a2f823e7d chore: Update .readthedocs.yaml configuration file 2024-09-09 11:14:38 +02:00
Stan Girard
d66d6cd12f
chore: Add .readthedocs.yaml configuration file (#3172)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-09 02:10:46 -07:00
Stan Girard
c9ddbbdcd3
chore: Add initial documentation files and configuration (#3126)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-09-09 02:06:16 -07:00
Stan Girard
b70ae63215
chore(main): release 0.0.308 (#3166)
🤖 I have created a release *beep* *boop*
---


## 0.0.308 (2024-09-06)

## What's Changed
* fix: remove knowledge and idle conn by @AmineDiro in
https://github.com/QuivrHQ/quivr/pull/3165


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.307...v0.0.308

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-09-06 07:25:47 -07:00
AmineDiro
89d9e2fcaf
fix: remove knowledge and idle conn (#3165)
# Description

- Add set session idle conn
- Remove brain vectore in knowledge routees ( knowledge cascades to
vectors now), should speed up th
- Add session rollback/commit to worker

TODO: Should refactor session in worker . The design async+ celery is
starting to be really bad
2024-09-06 06:56:07 -07:00