phpbench

# compare previously recorded report with latest
$ phpbench report --uuid=133a1f6cb0331c2cedeb650f0b997f5fb3c28713 --uuid=latest --report=aggregate
suite: 133a1f6965d13f41f33ec1ba76370c4120dd45c1
+-----------+----------+--------+---------------+------+-----+------------+----------+----------+----------+----------+----------+--------+---------+
| benchmark | subject  | groups | params        | revs | its | mem_peak   | best     | mean     | mode     | worst    | stdev    | rstdev | diff    |
+-----------+----------+--------+---------------+------+-----+------------+----------+----------+----------+----------+----------+--------+---------+
| KdeBench  | benchKde |        | {"points":10} | 100  | 10  | 1,102,568b | 0.3117ms | 0.3693ms | 0.3331ms | 0.5658ms | 0.0759ms | 20.56% | 0.00%   |
| KdeBench  | benchKde |        | {"points":20} | 100  | 10  | 1,107,048b | 0.5799ms | 0.7697ms | 0.8444ms | 0.9212ms | 0.1198ms | 15.56% | +52.02% |
| KdeBench  | benchKde |        | {"points":40} | 100  | 10  | 1,116,008b | 1.0698ms | 1.2354ms | 1.2147ms | 1.4126ms | 0.1141ms | 9.24%  | +70.11% |
+-----------+----------+--------+---------------+------+-----+------------+----------+----------+----------+----------+----------+--------+---------+

suite: 133a1f6cb0331c2cedeb650f0b997f5fb3c28713
+-----------+----------+--------+---------------+------+-----+------------+----------+----------+----------+----------+----------+--------+---------+
| benchmark | subject  | groups | params        | revs | its | mem_peak   | best     | mean     | mode     | worst    | stdev    | rstdev | diff    |
+-----------+----------+--------+---------------+------+-----+------------+----------+----------+----------+----------+----------+--------+---------+
| KdeBench  | benchKde |        | {"points":10} | 100  | 10  | 1,102,568b | 0.3197ms | 0.4151ms | 0.3838ms | 0.5410ms | 0.0753ms | 18.13% | 0.00%   |
| KdeBench  | benchKde |        | {"points":20} | 100  | 10  | 1,107,048b | 0.5840ms | 0.7162ms | 0.6048ms | 0.9072ms | 0.1215ms | 16.97% | +42.04% |
| KdeBench  | benchKde |        | {"points":40} | 100  | 10  | 1,116,008b | 1.0518ms | 1.2367ms | 1.1337ms | 1.5277ms | 0.1587ms | 12.83% | +66.43% |
+-----------+----------+--------+---------------+------+-----+------------+----------+----------+----------+----------+----------+--------+---------+

# show comparison in columns (group by benchmark instead of "suite")
$ phpbench report --uuid=133a1f6cb0331c2cedeb650f0b997f5fb3c28713 --uuid=latest --report='extends: aggregate, break: [ "benchmark" ], compare: "suite" '
benchmark: KdeBench
+----------+--------+---------------+------+-----+------------+-----------------------------------------------------+-----------------------------------------------------+
| subject  | groups | params        | revs | its | mem_peak   | suite:133a1f6cb0331c2cedeb650f0b997f5fb3c28713:mean | suite:133a1f6965d13f41f33ec1ba76370c4120dd45c1:mean |
+----------+--------+---------------+------+-----+------------+-----------------------------------------------------+-----------------------------------------------------+
| benchKde |        | {"points":10} | 100  | 10  | 1,102,568b | 0.4151ms                                            | 0.3693ms                                            |
| benchKde |        | {"points":20} | 100  | 10  | 1,107,048b | 0.7162ms                                            | 0.7697ms                                            |
| benchKde |        | {"points":40} | 100  | 10  | 1,116,008b | 1.2367ms                                            | 1.2354ms                                            |
+----------+--------+---------------+------+-----+------------+-----------------------------------------------------+-----------------------------------------------------+