Commit Graph

1858 Commits

Author SHA1 Message Date
Stan Girard
30b9e057ff
feat(db): Add Supabase client and database instances caching (#2513)
This pull request adds caching for the Supabase client and database
instances in order to improve performance and reduce unnecessary API
calls. The `get_supabase_client()` and `get_supabase_db()` functions now
check if the instances have already been created and return the cached
instances if available. This avoids creating new instances for every
function call, resulting in faster execution times.
2024-04-28 06:46:16 -07:00
Stan Girard
bdb115ad0a
feat(profiler): Add pyinstrument package and update Makefile and backend code (#2512)
This pull request adds the pyinstrument package and updates the Makefile
and backend code. The pyinstrument package is used for profiling and the
Makefile and backend code have been modified to support profiling.
2024-04-28 06:10:21 -07:00
Stan Girard
eb360830e0 Update Dockerfile dependencies 2024-04-28 14:34:44 +02:00
Stan Girard
d2086a97d3 Refactor logging configuration and remove unused imports 2024-04-28 13:35:07 +02:00
porter-deployment-app[bot]
7725c1005b
Enable Porter Application quivr-com (#2511)
Hello 👋 from Porter! Please merge this PR to finish setting up your
application.

Co-authored-by: porter-deployment-app[bot] <87230664+porter-deployment-app[bot]@users.noreply.github.com>
2024-04-27 14:50:04 -07:00
porter-deployment-app[bot]
d9150e9431
Enable Porter Application quivr-com-backend (#2510)
Hello 👋 from Porter! Please merge this PR to finish setting up your
application.

Co-authored-by: porter-deployment-app[bot] <87230664+porter-deployment-app[bot]@users.noreply.github.com>
2024-04-27 14:45:35 -07:00
Stan Girard
4050313078 Remove debug flag from supabase db push command 2024-04-27 15:35:24 +02:00
Stan Girard
b12fc4f4bf Remove supabase initialization from ci-migration.sh 2024-04-27 15:34:36 +02:00
Stan Girard
b3e8c3d711 Add Supabase schema, migrations, and .gitignore file 2024-04-27 15:31:43 +02:00
Stan Girard
74c0e2d72c Add Supabase to Dockerfile 2024-04-27 15:20:39 +02:00
Stan Girard
e28ef7d709 Add debug flag to supabase db push command 2024-04-27 15:09:55 +02:00
Stan Girard
5baf2f02e5 Add supabase db password to ci-migration script 2024-04-27 15:04:19 +02:00
Stan Girard
9bfa9f63c5 Update ci-migration.sh script with environment variable setup and supabase commands 2024-04-27 15:00:35 +02:00
Stan Girard
491b1f85bf Add supabase initialization to ci-migration.sh 2024-04-27 14:56:45 +02:00
Stan Girard
5c0e5db0d9
Feat/migration ci 2 (#2509)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-27 05:49:15 -07:00
Stan Girard
cba3ac3729
Add ci-migration script (#2508)
This pull request adds a ci-migration script that sets the project ID
from an environment variable and runs the supabase link and supabase db
push commands. This script will be used for continuous integration
purposes.
2024-04-27 05:43:12 -07:00
Stan Girard
785066f9cb
fix(metadata): Removed citation from metadata (#2507)
This pull request removes the citation metadata from the generate_answer
and generate_stream functions. The citation metadata was previously
being added to the streamed_chat_history and metadata dictionaries, but
it is no longer necessary. This change improves the efficiency and
clarity of the code.
2024-04-27 05:19:13 -07:00
Stan Girard
2be6aac02a
feat(embedding): keeping citations (#2506)
This pull request updates the chunk size and overlap parameters in the
File class to improve performance. It also increases the top_n value in
the compressor for both the CohereRerank and FlashrankRerank models.
Additionally, it ensures that the page content is encoded in UTF-8
before processing.
2024-04-27 05:18:51 -07:00
Antoine Dewez
e7ce2fa54b
feat(frontend): show remaining credits (#2495)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-27 04:44:48 -07:00
Antoine Dewez
6cde04b65f
fix(frontend): fix some next errors (#2503)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-27 04:43:02 -07:00
Stan Girard
e7b5699818
feat(docker): Update Dockerfile to install Supabase CLI (#2505)
This pull request updates the Dockerfile to include the installation of
the Supabase CLI. The Supabase CLI is required for interacting with the
Supabase backend. This update ensures that the Supabase CLI is installed
in the Docker image, allowing developers to easily use the Supabase CLI
within their Docker environment.
2024-04-27 04:42:24 -07:00
Stan Girard
89c0ab138c
docs: Update links in mint.json to add api (#2504)
This pull request updates the links in the mint.json file to include a
link to the API documentation. The "Blog" link has been replaced with an
"API Docs" link that points to https://api.quivr.app/docs.
2024-04-27 04:28:55 -07:00
Antoine Dewez
aa14d6336e
feat(frontend): add nb of knowledges per brain (#2502)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-27 10:19:44 +02:00
Stan Girard
b7ff2e77af
feat(citations): system added (#2498)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-26 08:11:01 -07:00
Stan Girard
19365c4bb5
chore(main): release 0.0.238 (#2491)
🤖 I have created a release *beep* *boop*
---


## 0.0.238 (2024-04-25)

## What's Changed
* Enable Porter Application cherry-pick-backend by
@porter-deployment-app in https://github.com/QuivrHQ/quivr/pull/2492
* Enable Porter Application cherry-pick-frontend by
@porter-deployment-app in https://github.com/QuivrHQ/quivr/pull/2493
* feat: Add telemetry ping task to celery worker and main.py by
@StanGirard in https://github.com/QuivrHQ/quivr/pull/2494
* fix(backend): compute history only if needed and put some cache to
remove some call… by @dmourot in
https://github.com/QuivrHQ/quivr/pull/2497


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.237...v0.0.238

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-04-26 00:49:22 -07:00
Damien Mourot
85c4835c59
fix(backend): compute history only if needed and put some cache to remove some call… (#2497)
… to the DB API

# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-25 15:18:12 -07:00
Stan Girard
2a25f442e5
feat: Add telemetry ping task to celery worker and main.py (#2494)
This pull request adds a new telemetry ping task to the celery worker
and main.py files. The ping task sends a ping message to the telemetry
system.
2024-04-25 07:22:13 -07:00
porter-deployment-app[bot]
55b456bfe1
Enable Porter Application cherry-pick-frontend (#2493)
Hello 👋 from Porter! Please merge this PR to finish setting up your
application.

Co-authored-by: porter-deployment-app[bot] <87230664+porter-deployment-app[bot]@users.noreply.github.com>
2024-04-25 04:18:35 -07:00
porter-deployment-app[bot]
6def307408
Enable Porter Application cherry-pick-backend (#2492)
Hello 👋 from Porter! Please merge this PR to finish setting up your
application.

Co-authored-by: porter-deployment-app[bot] <87230664+porter-deployment-app[bot]@users.noreply.github.com>
2024-04-25 04:11:24 -07:00
Stan Girard
0239d5d19c feat(porter): Add Porter.yaml files for backend and frontend services 2024-04-25 10:51:10 +02:00
Stan Girard
5a70735036
chore(main): release 0.0.237 (#2482)
🤖 I have created a release *beep* *boop*
---


## 0.0.237 (2024-04-24)

## What's Changed
* docs: Add environment variables, increase user usage, and add new
models by @StanGirard in https://github.com/QuivrHQ/quivr/pull/2481
* fix(frontend): Warning for Quivr Assistants by @Zewed in
https://github.com/QuivrHQ/quivr/pull/2479
* fix(frontend): better UI for Onboarding by @Zewed in
https://github.com/QuivrHQ/quivr/pull/2477
* docs: add new configuration items by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2483
* Revert "fix(frontend): better UI for Onboarding" by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2485
* feat(reranker): Add flashrank and contextual compression retriever by
@StanGirard in https://github.com/QuivrHQ/quivr/pull/2480
* feat(history): max tokens in the history provided by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2487
* feat: Update chunk overlap to 200 by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2488
* docs: Add reranking configuration guide by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2489
* docs: Update telemetry configuration in Quivr by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2490


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.236...v0.0.237

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-04-25 01:03:24 -07:00
Stan Girard
5a306b15cb
docs: Update telemetry configuration in Quivr (#2490)
This pull request updates the telemetry configuration in Quivr. The
guide now includes instructions on how to deactivate or configure the
telemetry service.
2024-04-24 14:29:20 -07:00
Stan Girard
0559075cd3
docs: Add reranking configuration guide (#2489)
This pull request adds a new guide to the documentation that explains
how to configure reranking in Quivr. The guide covers the steps to
configure the reranking service using the FlashrankRerank library and
the Cohere ReRanker. It also provides information on the required
environment variables and the default behavior of the Ranker.
2024-04-24 14:26:28 -07:00
Stan Girard
47491bc967
feat: Update chunk overlap to 200 (#2488)
This pull request updates the chunk overlap value in the File class from
300 to 200. This change reduces the overlap between chunks, improving
the performance of chunking operations.
2024-04-24 14:15:31 -07:00
Stan Girard
5c5e022990
feat(history): max tokens in the history provided (#2487)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-24 14:09:55 -07:00
Stan Girard
f656dbcb42
feat(reranker): Add flashrank and contextual compression retriever (#2480)
This pull request adds the flashrank and contextual compression
retriever to the codebase. The flashrank reranker model is used for
compression, and the contextual compression retriever combines the base
compressor and base retriever to improve document retrieval.
2024-04-24 10:44:31 -07:00
Stan Girard
7ead787626
Revert "fix(frontend): better UI for Onboarding" (#2485)
Reverts QuivrHQ/quivr#2477
2024-04-24 05:37:59 -07:00
Stan Girard
d54f370ed4
docs: add new configuration items (#2483)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-24 03:34:24 -07:00
Antoine Dewez
b33e00672a
fix(frontend): better UI for Onboarding (#2477)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-24 01:01:54 -07:00
Antoine Dewez
fe8cfe78ca
fix(frontend): Warning for Quivr Assistants (#2479)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-24 00:57:45 -07:00
Stan Girard
56e79207bb
docs: Add environment variables, increase user usage, and add new models (#2481)
This pull request adds environment variables, increases user usage, and
adds new models to the Quivr application. It includes the following
commits:

- docs: Add environment variables, increase user usage, and add new
models
2024-04-23 15:55:43 -07:00
Stan Girard
f8693e223a
chore(main): release 0.0.236 (#2466)
🤖 I have created a release *beep* *boop*
---


## 0.0.236 (2024-04-23)

## What's Changed
* feat(docs): update to new by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2465
* feat(docs): Add new brain files and update navigation by @StanGirard
in https://github.com/QuivrHQ/quivr/pull/2467
* Feat/docs category brains agents by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2469
* fix(docs): update doc by @Zewed in
https://github.com/QuivrHQ/quivr/pull/2470
* feat(digital-ocean): Update deployment instructions for Digital Ocean
by @StanGirard in https://github.com/QuivrHQ/quivr/pull/2472
* docs(digital-ocean): added missing photo by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2473
* docs: Update brain documentation and images by @StanGirard in
https://github.com/QuivrHQ/quivr/pull/2475


**Full Changelog**:
https://github.com/QuivrHQ/quivr/compare/v0.0.235...v0.0.236

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-04-23 07:37:37 -07:00
Stan Girard
751d849b5e
docs: Update brain documentation and images (#2475)
This pull request updates the documentation and images for the default
brain in Quivr. It includes instructions on how to get started,
customize the brain, and ask questions. Additionally, it adds
documentation for the GPT-4 brain and provides steps on how to interact
with it.
2024-04-23 02:21:51 -07:00
Stan Girard
6a7a743b8c
docs(digital-ocean): added missing photo (#2473)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-22 16:14:51 -07:00
Stan Girard
b9ea536836
feat(digital-ocean): Update deployment instructions for Digital Ocean (#2472)
This pull request updates the deployment instructions for Digital Ocean
in the Quivr repository. The instructions now include step-by-step
details on creating a Droplet, choosing the Docker image, updating the
.env file, installing Supabase, allowing the firewall, and launching the
project. The new instructions provide a more comprehensive guide for
deploying Quivr on Digital Ocean.
2024-04-22 16:13:14 -07:00
Stan Girard
75a37491fb Add network configuration to docker-compose.yml 2024-04-23 00:46:47 +02:00
Antoine Dewez
8b68aeb64f
fix(docs): update doc (#2470)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-23 00:40:29 +02:00
Stan Girard
777a6d80ea
Feat/docs category brains agents (#2469)
# Description

Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.

## Checklist before requesting a review

Please delete options that are not relevant.

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged

## Screenshots (if appropriate):
2024-04-22 15:33:36 -07:00
Stan Girard
5ab1a6fe21
feat(docs): Add new brain files and update navigation (#2467)
This pull request adds new brain files and updates the navigation to
include the new files.
2024-04-22 09:39:24 -07:00
Stan Girard
0fd99fe5b2
feat(docs): update to new (#2465)
This pull request updates the API documentation to include new sections
on configuring Quivr and contacting the Quivr team. It also removes the
"API Brains" section from the documentation.
2024-04-22 08:34:11 -07:00