zed-industries/zed
1
1
Fork 0
mirror of https://github.com/zed-industries/zed.git synced 2024-12-29 05:11:44 +03:00
Code Issues Packages Projects Releases Wiki Activity
3c2b05be90
zed/crates/semantic_index
History
Kyle Caverly 3c2b05be90
add semantic index status, for non authenticated users (#3005) 
Update project search semantic ui to accommodate for users who have not
set the OPENAI_API_KEY in their environment variables.

Release Notes:

- Expand Semantic Index status to include status for non authenticated
users
- Update Search UI to illustrate this status.
2023-09-21 14:18:58 -04:00
..
eval add recall and precision to semantic index 2023-09-18 18:25:02 -04:00
examples fix warnings 2023-09-19 19:05:26 -04:00
src add semantic index status, for non authenticated users (#3005) 2023-09-21 14:18:58 -04:00
Cargo.toml remove git2 dependency for repository cloning in semantic_index eval 2023-09-19 18:55:15 -04:00
README.md add eval values for tree-sitter 2023-09-12 20:36:06 -04:00

README.md

Semantic Index

Evaluation

Metrics

nDCG@k:

  • "The value of NDCG is determined by comparing the relevance of the items returned by the search engine to the relevance of the item that a hypothetical "ideal" search engine would return.
  • "The relevance of result is represented by a score (also known as a 'grade') that is assigned to the search query. The scores of these results are then discounted based on their position in the search results -- did they get recommended first or last?"

MRR@k:

  • "Mean reciprocal rank quantifies the rank of the first relevant item found in teh recommendation list."

MAP@k:

  • "Mean average precision averages the precision@k metric at each relevant item position in the recommendation list.

Resources: