CodedotAl/gpt-code-clippy
1
1
Fork 0
mirror of https://github.com/CodedotAl/gpt-code-clippy.git synced 2024-07-14 18:20:24 +03:00
Code Issues Projects Releases Wiki Activity

Add example for evaluation

Browse Source
This commit is contained in:
ncoop57 2021-10-09 17:12:06 +00:00
parent 9e2213465b
commit d2ba68d48e
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
evaluation/README.md
View File

@ -18,4 +18,8 @@ With the following requirements performed you can now run the `evaluation.py` sc
```
python evaluate.py --model_name_or_path=model_name_or_path --human_eval_path=<path/to/human-eval/data/HumanEval.jsonl.gz> --out_path=./model_results
```
So for example if you want to evaluate the EleutherAI GPT Neo 125M
So for example if you want to evaluate the EleutherAI GPT Neo 125M
```
python evaluate.py EleutherAI/gpt-neo-125M ../dependency_repos/human-eval/data/HumanEval.jsonl.gz model_results/
```