AmineDiro
71edca572f
feat: CRUD KMS (no syncs) ( #3162 )
...
# Description
closes #3056 .
closes #3198
- Create knowledge route
- Get knowledge route
- List knowledge route : accepts knowledge_id | None. None to list root
knowledge for use
- Update (patch) knowledge to rename and move knowledge
- Remove knowledge: Cascade if parent_id in knowledge and cleanup
storage
- Link storage upload to knowledge_service
- Relax sha1 file constraint
- Tests to all repository / service
---------
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2024-09-16 04:31:09 -07:00
Stan Girard
380cf82706
feat: quivr core 0.1 ( #2970 )
...
# Description
# Testing backend
## Docker setup
1. Copy `.env.example` to `.env`. Some env variables were added :
EMBEDDING_DIM
2. Apply supabase migratrions :
```sh
supabase stop
supabase db reset
supabase start
```
3. Start backend containers
```
make dev
```
## Local setup
You can also run backend without docker.
1. Install [`rye`](https://rye.astral.sh/guide/installation/ ). Choose
the managed python version and set the version to 3.11
2. Run the following:
```
cd quivr/backend
rye sync
```
3. Source `.venv` virtual env : `source .venv/bin/activate`
4. Run the backend, make sure you are running redis and supabase
API:
```
LOG_LEVEL=debug uvicorn quivr_api.main:app --log-level debug --reload --host 0.0.0.0 --port 5050 --workers 1
```
Worker:
```
LOG_LEVEL=debug celery -A quivr_worker.celery_worker worker -l info -E --concurrency 1
```
Notifier:
```
LOG_LEVEL=debug python worker/quivr_worker/celery_monitor.py
```
---------
Co-authored-by: chloedia <chloedaems0@gmail.com>
Co-authored-by: aminediro <aminedirhoussi1@gmail.com>
Co-authored-by: Antoine Dewez <44063631+Zewed@users.noreply.github.com>
Co-authored-by: Chloé Daems <73901882+chloedia@users.noreply.github.com>
Co-authored-by: Zewed <dewez.antoine2@gmail.com>
2024-09-02 10:20:53 +02:00
Stan Girard
c95c35499f
Refactor GitHub workflows ( #2261 )
...
This pull request refactors the GitHub workflows for backend tests and
deployment to preview and production environments. The changes include
updating the workflow triggers, setting up Python versions, installing
system dependencies, and running pytest.
2024-02-24 09:15:27 -08:00
renovate[bot]
fe373fdd10
chore(deps): pin dependencies ( #1975 )
...
[](https://renovatebot.com )
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [actions/checkout](https://togithub.com/actions/checkout ) | action |
pinDigest | -> `b4ffde6` |
| [actions/setup-node](https://togithub.com/actions/setup-node ) | action
| pinDigest | -> `b39b52d` |
| [actions/setup-python](https://togithub.com/actions/setup-python ) |
action | pinDigest | -> `65d7f2d` |
|
[aws-actions/amazon-ecr-login](https://togithub.com/aws-actions/amazon-ecr-login )
| action | pinDigest | -> `2fc7ace` |
|
[aws-actions/amazon-ecs-deploy-task-definition](https://togithub.com/aws-actions/amazon-ecs-deploy-task-definition )
| action | pinDigest | -> `df96430` |
|
[aws-actions/amazon-ecs-render-task-definition](https://togithub.com/aws-actions/amazon-ecs-render-task-definition )
| action | pinDigest | -> `4225e0b` |
|
[aws-actions/configure-aws-credentials](https://togithub.com/aws-actions/configure-aws-credentials )
| action | pinDigest | -> `5fd3084` |
| darthsim/imgproxy | | pinDigest | -> `0facd35` |
|
[docker/build-push-action](https://togithub.com/docker/build-push-action )
| action | pinDigest | -> `0a97817` |
|
[docker/build-push-action](https://togithub.com/docker/build-push-action )
| action | pinDigest | -> `4a13e50` |
| [docker/login-action](https://togithub.com/docker/login-action ) |
action | pinDigest | -> `465a078` |
| [docker/login-action](https://togithub.com/docker/login-action ) |
action | pinDigest | -> `343f7c4` |
|
[docker/setup-buildx-action](https://togithub.com/docker/setup-buildx-action )
| action | pinDigest | -> `885d146` |
|
[docker/setup-buildx-action](https://togithub.com/docker/setup-buildx-action )
| action | pinDigest | -> `f95db51` |
|
[docker/setup-qemu-action](https://togithub.com/docker/setup-qemu-action )
| action | pinDigest | -> `6882732` |
|
[google-github-actions/release-please-action](https://togithub.com/google-github-actions/release-please-action )
| action | pinDigest | -> `db8f2c6` |
| kong | | pinDigest | -> `1b53405` |
| [pavelzw/pytest-action](https://togithub.com/pavelzw/pytest-action ) |
action | pinDigest | -> `510c5e9` |
| postgrest/postgrest | | pinDigest | -> `23b2dab` |
| python | final | pinDigest | -> `0c1fbb2` |
| redis | | pinDigest | -> `a7cee7c` |
| supabase/edge-runtime | | pinDigest | -> `4e02aac` |
| supabase/gotrue | | pinDigest | -> `b503f1f` |
| supabase/logflare | | pinDigest | -> `e693c78` |
| supabase/postgres | | pinDigest | -> `fb8387f` |
| supabase/postgres-meta | | pinDigest | -> `31a107d` |
| supabase/realtime | | pinDigest | -> `634a59e` |
| supabase/storage-api | | pinDigest | -> `2cd146f` |
| supabase/studio | | pinDigest | -> `393669f` |
| timberio/vector | | pinDigest | -> `4bc04ac` |
---
### Configuration
📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
👻 **Immortal**: This PR will be recreated if closed unmerged. Get
[config help](https://togithub.com/renovatebot/renovate/discussions ) if
that's undesired.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR has been generated by [Mend
Renovate](https://www.mend.io/free-developer-tools/renovate/ ). View
repository job log
[here](https://developer.mend.io/github/StanGirard/quivr ).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4xMDMuMSIsInVwZGF0ZWRJblZlciI6IjM3LjEwMy4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiJ9-->
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-04 14:00:18 +01:00
renovate[bot]
36c1289a7c
chore(deps): Update actions/checkout action to v4 ( #1957 )
...
[](https://renovatebot.com )
This PR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [actions/checkout](https://togithub.com/actions/checkout ) | action |
major | `v3` -> `v4` |
---
### Release Notes
<details>
<summary>actions/checkout (actions/checkout)</summary>
###
[`v4`](https://togithub.com/actions/checkout/blob/HEAD/CHANGELOG.md#v400 )
[Compare Source](https://togithub.com/actions/checkout/compare/v3...v4 )
- [Support fetching without the --progress
option](https://togithub.com/actions/checkout/pull/1067 )
- [Update to node20](https://togithub.com/actions/checkout/pull/1436 )
</details>
---
### Configuration
📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR has been generated by [Mend
Renovate](https://www.mend.io/free-developer-tools/renovate/ ). View
repository job log
[here](https://developer.mend.io/github/StanGirard/quivr ).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4xMDMuMSIsInVwZGF0ZWRJblZlciI6IjM3LjEwMy4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiJ9-->
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-03 12:08:02 +01:00
Stan Girard
6017fa2e9c
test(contact): added contact route with mock
2023-11-13 17:58:11 +01:00
Stan Girard
6bc9dd1894
ci: 🎡 tests ( #1615 )
...
fixed
# Description
Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.
## Checklist before requesting a review
Please delete options that are not relevant.
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged
## Screenshots (if appropriate):
2023-11-13 13:53:25 +01:00
Stan Girard
1d33fbd3eb
feat(file-system): added queue and filesystem ( #1159 )
...
* feat(queue): added
* feat(crawling): added queue
* fix(crawler): fixed github
* feat(docker): simplified docker compose
* feat(celery): added worker
* feat(files): now uploaded
* feat(files): missing routes
* feat(delete): added
* feat(storage): added policy and migrations
* feat(sqs): implemented
* feat(redis): added queue name variable
* fix(task): updated
* style(env): emoved unused env
* ci(tests): removed broken tests
2023-09-14 11:56:59 +02:00
Stan Girard
d0370ab499
feat(refacto): changed a bit of things to make better dx ( #984 )
2023-08-19 13:32:16 +02:00
Noe
303ba72028
feat: Introduce repository pattern to prepare adding other database providers ( #646 )
...
* add sqlalchemy models
* add neon settings
* add insert brain
* abstract supabase from Brain class
* abstract supabase from Brain class
* abstract supabase from /models
* update Database to Repository
* update neon_tables to pg_tables
* update chat, api-key and message
* update vector class
* update settings
* update env vars for test
* Update backend-tests.yml
* fix test
* fix fetch_user_requests_count()
* fix fetch_user_requests_count()
* fix increment_user_request_count
* fix increment_user_request_count
* fix asset upload_response message
* fix pyright
* fix brain_subscription
* fix brain_subscription
* fix brain_subscription
* fix get user request stat
* update create_brain_user
* add delete brain vector and user
* add delete brain vector and user
* correctly call function
---------
Co-authored-by: Noé Pion <noe.pion@onfido.com>
Co-authored-by: raoufchebri <raouf@chebri.com>
Co-authored-by: Stan Girard <girard.stanislas@gmail.com>
2023-08-01 23:03:47 +02:00
Matt
e61f437ce8
Feat/backend core ( #656 )
2023-07-17 07:57:27 +01:00
Matt
9f2cd7b7b6
fix: bug if no brain ( #635 )
2023-07-14 20:02:26 +01:00
Mamadou DICKO
9ee86222a4
chore(ci): add static type checking step ( #583 )
2023-07-10 15:22:17 +02:00
