Created
February 1, 2011 23:50
-
-
Save gregorycollins/806982 to your computer and use it in GitHub Desktop.
Sample output from "criterion-collection"
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| warming up | |
| estimating clock resolution... | |
| mean is 11.41351 us (80001 iterations) | |
| found 7313 outliers among 79999 samples (9.1%) | |
| 1159 (1.4%) high mild | |
| 6137 (7.7%) high severe | |
| estimating cost of a clock call... | |
| mean is 166.3485 ns (77 iterations) | |
| found 8 outliers among 77 samples (10.4%) | |
| 3 (3.9%) high mild | |
| 5 (6.5%) high severe | |
| making 1000 data items | |
| made 1000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 27.04787 ms | |
| collecting 850 samples (in chunks of 425) in estimated 26.85570 ms | |
| ran 1000 iterations in 24.67918 ms | |
| collecting 932 samples (in chunks of 466) in estimated 24.49286 ms | |
| making 2000 data items | |
| made 2000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 2000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 24.22094 ms | |
| collecting 1900 samples (in chunks of 475) in estimated 48.05756 ms | |
| ran 1000 iterations in 23.75579 ms | |
| collecting 1936 samples (in chunks of 484) in estimated 47.16393 ms | |
| making 4000 data items | |
| made 4000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 4000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 23.79608 ms | |
| collecting 3872 samples (in chunks of 484) in estimated 94.32786 ms | |
| ran 1000 iterations in 23.45705 ms | |
| collecting 3928 samples (in chunks of 491) in estimated 92.98307 ms | |
| making 8000 data items | |
| made 8000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 8000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 23.91005 ms | |
| collecting 7696 samples (in chunks of 481) in estimated 189.8324 ms | |
| ran 1000 iterations in 23.98205 ms | |
| collecting 7680 samples (in chunks of 480) in estimated 190.2279 ms | |
| making 16000 data items | |
| made 16000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 16000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 22.49002 ms | |
| collecting 15872 samples (in chunks of 512) in estimated 356.6772 ms | |
| ran 1000 iterations in 22.22419 ms | |
| collecting 15540 samples (in chunks of 518) in estimated 352.5458 ms | |
| making 32000 data items | |
| made 32000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 32000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 26.42298 ms | |
| collecting 31755 samples (in chunks of 435) in estimated 839.6264 ms | |
| ran 1000 iterations in 26.04604 ms | |
| collecting 31824 samples (in chunks of 442) in estimated 826.3292 ms | |
| making 64000 data items | |
| made 64000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 64000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 22.28594 ms | |
| collecting 51600 samples (in chunks of 516) in estimated 1.141367 s | |
| ran 1000 iterations in 22.71485 ms | |
| collecting 50700 samples (in chunks of 507) in estimated 1.141367 s | |
| making 128000 data items | |
| made 128000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 128000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 23.72313 ms | |
| collecting 48500 samples (in chunks of 485) in estimated 1.141367 s | |
| ran 1000 iterations in 26.07417 ms | |
| collecting 44100 samples (in chunks of 441) in estimated 1.141367 s | |
| making 256000 data items | |
| made 256000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 256000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 22.63618 ms | |
| collecting 50800 samples (in chunks of 508) in estimated 1.141367 s | |
| ran 1000 iterations in 25.22492 ms | |
| collecting 45600 samples (in chunks of 456) in estimated 1.141367 s | |
| making 512000 data items | |
| made 512000 data items | |
| uniformLookupWorkload: generating 1000 lookups | |
| uniformLookupWorkload: done | |
| uniformLookupWorkload: generating 512000 lookups | |
| uniformLookupWorkload: done | |
| ran 1000 iterations in 25.19107 ms | |
| collecting 45700 samples (in chunks of 457) in estimated 1.141367 s | |
| ran 1000 iterations in 24.77908 ms | |
| collecting 46400 samples (in chunks of 464) in estimated 1.141367 s | |
| Results for Data.Map vs Data.Hashtable Lookup Performance | |
| ------------------------------------------------------------------------------ | |
| Data structure Data.Map | |
| Input Sz Mean (secs) Stddev (secs) 95% (secs) Max (secs) | |
| -------------- -------------- -------------- -------------- -------------- | |
| 1000 58.23151 ns 23.40390 ns 71.47076 ns 74.78057 ns | |
| 2000 48.08641 ns 8.992884 ns 58.27567 ns 60.88572 ns | |
| 4000 53.84235 ns 9.522798 ns 65.76327 ns 70.09816 ns | |
| 8000 115.3008 ns 201.4535 ns 251.5550 ns 868.5684 ns | |
| 16000 73.73027 ns 22.36127 ns 117.0217 ns 138.4422 ns | |
| 32000 137.6834 ns 190.4271 ns 427.7297 ns 1.040986 us | |
| 64000 133.0442 ns 144.2511 ns 222.3864 ns 792.5580 ns | |
| 128000 246.9979 ns 185.9123 ns 296.5742 ns 1.304814 us | |
| 256000 247.8297 ns 156.1082 ns 286.9012 ns 1.019522 us | |
| 512000 298.2435 ns 221.1324 ns 299.6156 ns 1.605440 us | |
| Data structure Data.Hashtable | |
| Input Sz Mean (secs) Stddev (secs) 95% (secs) Max (secs) | |
| -------------- -------------- -------------- -------------- -------------- | |
| 1000 124.9919 ns 7.235510 ns 129.0849 ns 130.1081 ns | |
| 2000 118.8656 ns 9.198139 ns 128.4220 ns 129.7028 ns | |
| 4000 169.6740 ns 131.7317 ns 355.2011 ns 494.4647 ns | |
| 8000 165.3978 ns 86.77899 ns 246.5160 ns 484.9346 ns | |
| 16000 173.1230 ns 41.17576 ns 223.5990 ns 358.6875 ns | |
| 32000 343.1520 ns 170.9601 ns 764.6129 ns 996.9901 ns | |
| 64000 327.4998 ns 97.97514 ns 491.0869 ns 855.5335 ns | |
| 128000 647.5699 ns 108.3488 ns 870.5805 ns 974.9224 ns | |
| 256000 1.151019 us 171.3227 ns 1.440081 us 1.630920 us | |
| 512000 2.307636 us 992.8520 ns 4.155010 us 5.963189 us |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment