enso-org/enso
1
1
Fork 0
mirror of https://github.com/enso-org/enso.git synced 2024-12-01 22:23:30 +03:00
Code Issues Projects Releases Wiki Activity
c7da5f82c2
enso/tools/performance/engine-benchmarks
History
Pavel Marek c7da5f82c2
Engine benchmark visualization tool can compare two bench runs (#6198) 
Add `--compare <bench-run-id-1> <bench-run-id-2>` option to `bench_download.py` script, that prints the difference of benchmark scores for two benchmark runs from GH as a table.

# Important Notes
I tried to add an option to compare two or more branches and visualize them in the graphs, but gave that up after some struggling.
2023-04-05 19:03:50 +00:00
..
Engine_Benchs Add engine benchmark analysis tool (#5852) 2023-03-28 15:56:24 +00:00
bench_download.py Engine benchmark visualization tool can compare two bench runs (#6198) 2023-04-05 19:03:50 +00:00
README.md Add engine benchmark analysis tool (#5852) 2023-03-28 15:56:24 +00:00
template_jinja.html Add engine benchmark analysis tool (#5852) 2023-03-28 15:56:24 +00:00

README.md

Engine benchmarks

This directory contains a python script bench_download.py for downloading Engine benchmark results from GitHub and Engine_Benchs Enso project for analysing the downloaded data.

Dependencies for bench_download.py:

  • python >= 3.7
  • pandas and jinja2
    • Install, e.g., by pip install pandas jinja2
  • GH CLI utility

Check bench_download -h for documentation and usage. Ensure that your /usr/bin/env python links to Python version at least 3.7.

One can also analyze the benchmarks in Enso IDE by running bench_download.py --create-csv and then running Engine_Benchs project. The created CSV is pasted into Engine_Benchs/data directory by default.