mirror of
https://github.com/StanGirard/quivr.git
synced 2024-12-02 08:40:53 +03:00
38589d32cf
# Description
Please include a summary of the changes and the related issue. Please
also include relevant motivation and context.
## Checklist before requesting a review
Please delete options that are not relevant.
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented hard-to-understand areas
- [ ] I have ideally added tests that prove my fix is effective or that
my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged
## Screenshots (if appropriate):
<!--
ELLIPSIS_HIDDEN
-->
----
| <a href="https://ellipsis.dev" target="_blank"><img
src="https://avatars.githubusercontent.com/u/80834858?s=400&u=31e596315b0d8f7465b3ee670f25cea677299c96&v=4"
alt="Ellipsis" width="30px" height="30px"/></a> | 🚀 This PR
description was created by [Ellipsis](https://www.ellipsis.dev) for
commit 5350e0a071. |
|--------|--------|
### Summary:
This PR adds a new script for evaluating the RAG model using the Ragas
library, with results saved as a JSON file and printed to the console.
**Key points**:
- New script `run_evaluation.py` added to
`backend/tests/ragas_evaluation/`.
- The script processes documents, generates replies using a QuivrRAG
chain, and evaluates the replies using specified metrics.
- Results are saved as a JSON file and printed to the console.
- The script can be run from the command line with various options.
----
Generated with ❤️ by [ellipsis.dev](https://www.ellipsis.dev)
<!--
ELLIPSIS_HIDDEN
-->
---------
Co-authored-by: Damien Mourot <damien.mourot@gmail.com>
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
86 lines
1.2 KiB
Plaintext
86 lines
1.2 KiB
Plaintext
docker-compose.override.yml
|
|
secondbrain/
|
|
.env
|
|
.streamlit/secrets.toml
|
|
**/*.pyc
|
|
toto.txt
|
|
*.ipynb
|
|
log.txt
|
|
|
|
backend/venv
|
|
backend/.env
|
|
backend/*.deb
|
|
backend/.python-version
|
|
|
|
# See https://help.github.com/articles/ignoring-files/ for more about ignoring files.
|
|
|
|
# dependencies
|
|
**/node_modules
|
|
**/.pnp
|
|
.pnp.js
|
|
|
|
# testing
|
|
**/coverage
|
|
|
|
# next.js
|
|
**/.next/
|
|
**/out/
|
|
|
|
# production
|
|
**/build
|
|
|
|
# misc
|
|
.DS_Store
|
|
*.pem
|
|
|
|
# debug
|
|
npm-debug.log*
|
|
yarn-debug.log*
|
|
yarn-error.log*
|
|
|
|
# local env files
|
|
.env*.local
|
|
|
|
# vercel
|
|
.vercel
|
|
|
|
# typescript
|
|
*.tsbuildinfo
|
|
next-env.d.ts
|
|
quivr/*
|
|
streamlit-demo/.streamlit/secrets.toml
|
|
.backend_env
|
|
.frontend_env
|
|
backend/core/pandoc-*
|
|
**/.pandoc-*
|
|
backend/core/application_default_credentials.json
|
|
|
|
#local models
|
|
backend/core/local_models/*
|
|
|
|
## scripts
|
|
package-lock.json
|
|
backend/celerybeat-schedule
|
|
frontend/public/robots.txt
|
|
frontend/public/sitemap*
|
|
|
|
pyfiles/*
|
|
backend/bin/*
|
|
backend/lib/*
|
|
backend/pyvenv.cfg
|
|
backend/share/*
|
|
backend/slim.report.json
|
|
volumes/db/data/
|
|
volumes/storage/stub/stub/quivr/*
|
|
supabase/migrations/20240103191539_private.sql
|
|
supabase/20240103191539_private.sql
|
|
paulgraham.py
|
|
.env_test
|
|
supabase/seed-airwallex.sql
|
|
airwallexpayouts.py
|
|
application.log
|
|
backend/celerybeat-schedule.db
|
|
|
|
backend/application.log.*
|
|
backend/score.json
|