zed/crates/semantic_index
Dzmitry Malyshau a44fc24445
Clean up many small dependencies (part 3) (#8425)
Follow-up to #8353

Release Notes:
- N/A
2024-02-26 11:08:57 +02:00
..
eval add recall and precision to semantic index 2023-09-18 18:25:02 -04:00
src Allow OpenAI API URL to be configured via assistant.openai_api_url (#7552) 2024-02-12 11:37:27 -05:00
Cargo.toml Clean up many small dependencies (part 3) (#8425) 2024-02-26 11:08:57 +02:00
LICENSE-GPL chore: Change AGPL-licensed crates to GPL (except for collab) (#4231) 2024-01-24 00:26:58 +01:00
README.md Fix typos detected by crate-ci/typos 2024-01-17 14:31:21 -08:00

Semantic Index

Evaluation

Metrics

nDCG@k:

  • "The value of NDCG is determined by comparing the relevance of the items returned by the search engine to the relevance of the item that a hypothetical "ideal" search engine would return.
  • "The relevance of result is represented by a score (also known as a 'grade') that is assigned to the search query. The scores of these results are then discounted based on their position in the search results -- did they get recommended first or last?"

MRR@k:

  • "Mean reciprocal rank quantifies the rank of the first relevant item found in the recommendation list."

MAP@k:

  • "Mean average precision averages the precision@k metric at each relevant item position in the recommendation list.

Resources: