Commit Graph

474 Commits

Author SHA1 Message Date
Thiago Arrais
e1fea57182 Adds tip for benchmarking aliases and functions 2020-10-26 20:38:45 +01:00
Julian Kaindl
c05d7f9480
Add command exit code to output if it fails 2020-10-25 19:04:17 +01:00
Martin Junghanns
990ed45c3a
Create export file before first benchmark (#340) 2020-10-18 09:15:44 +02:00
Martin Junghanns
2547342644 Update changelog 2020-10-18 09:13:56 +02:00
Martin Junghanns
d7e6fa6dfb Export intermediate results after each benchmark command 2020-10-18 09:13:56 +02:00
sharkdp
4fa16852cf Update help text 2020-10-17 00:07:06 +02:00
sharkdp
e947a62ce2 Update dependencies 2020-10-16 23:58:52 +02:00
sharkdp
118baa90c9 Bump version to 1.11.0 2020-10-16 23:57:59 +02:00
sharkdp
46ad9bf39a Show error if numeric arguments can not be parsed
Shows an error message if the argument to options like '--warmup <N>'
can not be parsed:

    > hyperfine --warmup xxx "sleep 1"
    Error: Could not read numeric argument to '--warmup': invalid digit found in string

closes #337
2020-10-16 23:55:14 +02:00
sharkdp
f67763fd34 Use skip_cleanup to prevent cleaning 2020-10-16 23:13:54 +02:00
David Peter
699d8ca329
Add ARM binaries
closes #331
2020-10-16 13:17:30 +02:00
sharkdp
b2a246c195 Fix nan/inf output for very fast commands
closes #319
2020-10-16 11:00:49 +02:00
sharkdp
314e4e3387 Bump min. required Rust version to 1.43 2020-10-15 23:05:04 +02:00
sharkdp
1477c68658 Add MAD=0 unit tests for outlier detection, see #329 2020-10-15 22:45:36 +02:00
Stéphane Campinas
25f8129212 return an error if there are more name options than commands 2020-10-15 22:42:44 +02:00
Stéphane Campinas
71a47c0566 use --command-name for the long option 2020-10-15 22:42:44 +02:00
Stéphane Campinas
746e5fe687 update man page with the name CLI option 2020-10-15 22:42:44 +02:00
Stéphane Campinas
83e5d3c7fb updated changelog 2020-10-15 22:42:44 +02:00
Stéphane Campinas
d548643561 add comment to HyperfineOptions#names field 2020-10-15 22:42:44 +02:00
Stéphane Campinas
0f0a109ca0 add CLI option to identify a command with a custom name
CLI option `--name` can be used to define the name to identify a
command. If not passed, then the command itself is used. Commands
and names are paired in the same order: The first command executed gets
the first name passed as option.

Close #326
2020-10-15 22:42:44 +02:00
sharkdp
674b5422ab Fix outlier detection for "fast outliers"
closes #329
2020-10-15 22:37:54 +02:00
sharkdp
daf5ced498 Keep output colorized for 'full' and 'color' style
fixes #332
2020-10-15 21:54:57 +02:00
William Chargin
89737785f8 [update patch]
wchargin-branch: param-list-matrix
wchargin-source: f866f0df2eae5f4bac2022c0db48edb0e8e6361e
2020-10-13 14:00:46 +02:00
William Chargin
a8a75a3b76 [update patch]
wchargin-branch: param-list-matrix
wchargin-source: 188f18839ad4bfce20c2c031cd6b00bcd94b67ad
2020-10-13 14:00:46 +02:00
William Chargin
e75747a0da [update patch]
wchargin-branch: param-list-matrix
wchargin-source: 15d5c2076ea44768e8c857dd467c327e5bfe7189
2020-10-13 14:00:46 +02:00
William Chargin
f6464a2943 Support matrices of independent parameter lists
This patch permits the `-L`/`--parameter-list` argument to appear
multiple times. Each additional parameter increases the dimensionality
of the parameter matrix. One benchmark will be run for each combination
of parameters (i.e., the benchmark space is the Cartesian product of the
parameter spaces).

For now, `--parameter-list` and `--parameter-scan` are still mutually
exclusive. If desired, a follow-up change could similarly permit
multiple occurrences of `--parameter-scan` and also permit use of both
listed and scanned parameters together. (After all, `--parameter-scan`
can be thought of as syntactic sugar for a parameter list.)

This implementation is a little profligate with memory usage for
`BenchmarkResult`s: each result contains a separate copy of all
parameter names (as `String`s). This could be done away with by
threading lifetimes through the `BenchmarkResult`s, or by ref-counting
the names.

Because `BenchmarkResult`s now have maps with arbitrary key sets, we can
no longer use `serde` to serialize them to CSV. But a CSV writer is easy
to write by hand, so we just do that.

Fixes #253.

Test Plan:
Some unit tests included. As an integration test, try:

```
cargo run --release -- --runs 10 \
    -L foo foo1,foo2 -L bar bar9,bar8 \
    'echo {foo} {bar}' \
    'printf "%s\n" {foo} {bar}' \
    --export-csv /tmp/out
```

with all the export formats.

wchargin-branch: param-list-matrix
wchargin-source: 11051ab222c9de0fbc6ac6a080fbca48e05996c2
2020-10-13 14:00:46 +02:00
muxator
5a80a23bdc scripts: modify shebang to use "/usr/bin/env python"
Before this patch, executing directly one of these scripts, for example
`./plot_hystogram.py` in a unix-like environment meant that the default
system-level python would be used, regardless of an eventual activated
virtualenv.

This was due to the "#!/usr/bin/python" shebang.
Changing it to "/usr/bin/env python" is a fairly standard practice, keeps intact
the compatiblity with the system level python, and allows a user to run in a
virtualenv if he wants.
2020-10-13 12:49:36 +02:00
dependabot-preview[bot]
7cdd1f259f Bump rust_decimal from 1.7.0 to 1.8.1
Bumps [rust_decimal](https://github.com/paupino/rust-decimal) from 1.7.0 to 1.8.1.
- [Release notes](https://github.com/paupino/rust-decimal/releases)
- [Commits](https://github.com/paupino/rust-decimal/commits/1.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-10-01 23:03:29 +02:00
dependabot-preview[bot]
585c69af44 Bump libc from 0.2.76 to 0.2.77
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.76 to 0.2.77.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.76...0.2.77)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-10-01 23:03:19 +02:00
dependabot-preview[bot]
9d25c0e286 Bump serde_json from 1.0.57 to 1.0.58
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.57 to 1.0.58.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.57...v1.0.58)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-10-01 23:03:12 +02:00
dependabot-preview[bot]
c95933194b Bump serde from 1.0.115 to 1.0.116
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.115 to 1.0.116.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.115...v1.0.116)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-10-01 23:03:00 +02:00
dependabot-preview[bot]
e6c1a64d69 Bump clap from 2.33.1 to 2.33.3
Bumps [clap](https://github.com/clap-rs/clap) from 2.33.1 to 2.33.3.
- [Release notes](https://github.com/clap-rs/clap/releases)
- [Changelog](https://github.com/clap-rs/clap/blob/v2.33.3/CHANGELOG.md)
- [Commits](https://github.com/clap-rs/clap/compare/v2.33.1...v2.33.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-09-01 23:45:55 +02:00
dependabot-preview[bot]
0e198365fa Bump libc from 0.2.74 to 0.2.76
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.74 to 0.2.76.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.74...0.2.76)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-09-01 23:45:36 +02:00
dependabot-preview[bot]
0ce49b2c48 Bump serde from 1.0.114 to 1.0.115
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.114 to 1.0.115.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.114...v1.0.115)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-09-01 23:45:25 +02:00
dependabot-preview[bot]
9f6886604f Bump serde_json from 1.0.56 to 1.0.57
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.56 to 1.0.57.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.56...v1.0.57)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-08-01 22:06:42 +02:00
dependabot-preview[bot]
b1e1e55b96 Bump colored from 1.9.3 to 2.0.0
Bumps [colored](https://github.com/mackwic/colored) from 1.9.3 to 2.0.0.
- [Release notes](https://github.com/mackwic/colored/releases)
- [Changelog](https://github.com/mackwic/colored/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mackwic/colored/compare/v1.9.3...v2.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-08-01 09:54:49 +02:00
dependabot-preview[bot]
000139a3d3 Bump rust_decimal from 1.6.0 to 1.7.0
Bumps [rust_decimal](https://github.com/paupino/rust-decimal) from 1.6.0 to 1.7.0.
- [Release notes](https://github.com/paupino/rust-decimal/releases)
- [Commits](https://github.com/paupino/rust-decimal/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-08-01 09:52:43 +02:00
dependabot-preview[bot]
f7e08712c2 Bump libc from 0.2.71 to 0.2.74
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.71 to 0.2.74.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.71...0.2.74)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-08-01 09:50:12 +02:00
Cade Ekblad-Frank
9b7ded7feb Remove comment since it causes a syntax error when run with older versions of man (i.e. 1.6g on MacOS) 2020-07-30 21:21:58 +02:00
dependabot-preview[bot]
3ff9e510b2 Bump serde_json from 1.0.55 to 1.0.56
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.55 to 1.0.56.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.55...v1.0.56)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-01 16:44:49 +02:00
dependabot-preview[bot]
5a71de4056 Bump serde from 1.0.112 to 1.0.114
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.112 to 1.0.114.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.112...v1.0.114)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-01 15:01:10 +02:00
dependabot-preview[bot]
5a2095fb80 Bump winapi from 0.3.8 to 0.3.9
Bumps [winapi](https://github.com/retep998/winapi-rs) from 0.3.8 to 0.3.9.
- [Release notes](https://github.com/retep998/winapi-rs/releases)
- [Commits](https://github.com/retep998/winapi-rs/compare/0.3.8...0.3.9)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-01 09:11:33 +02:00
dependabot-preview[bot]
e58a7f1018 Bump serde_json from 1.0.53 to 1.0.55
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.53 to 1.0.55.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.53...v1.0.55)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-19 06:34:05 +02:00
dependabot-preview[bot]
af4c057ba6 Bump serde from 1.0.111 to 1.0.112
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.111 to 1.0.112.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.111...v1.0.112)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-19 06:33:38 +02:00
Igor Raits
20759b10a9 chore: Update indicatif to 0.15 2020-06-18 21:46:44 +02:00
David Peter
72f113ef4a
Update demo GIF 2020-06-07 23:09:27 +02:00
Tom
8de77e136a fix: PowerShell completions 2020-06-03 19:45:45 +02:00
David Peter
f3f623e7ea
Add packaging status 2020-06-01 10:14:03 +02:00
dependabot-preview[bot]
e412edfd67 Bump serde from 1.0.110 to 1.0.111
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.110 to 1.0.111.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.110...v1.0.111)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-01 06:58:32 +02:00
dependabot-preview[bot]
ddeaf7a9c3 Bump libc from 0.2.70 to 0.2.71
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.70 to 0.2.71.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.70...0.2.71)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-01 06:57:57 +02:00