Created
February 13, 2023 16:42
-
-
Save carljm/0ce27bcdb9e026defcba100e452a8ce2 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
mainopt.json | |
============ | |
Performance version: 1.0.6 | |
Report on Linux-5.15.0-1028-aws-x86_64-with-glibc2.31 | |
Number of logical CPUs: 72 | |
Start date: 2023-02-13 15:59:52.702512 | |
End date: 2023-02-13 16:37:24.927583 | |
ic2opt.json | |
=========== | |
Performance version: 1.0.6 | |
Report on Linux-5.15.0-1028-aws-x86_64-with-glibc2.31 | |
Number of logical CPUs: 72 | |
Start date: 2023-02-13 15:05:58.971659 | |
End date: 2023-02-13 15:43:16.543970 | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| Benchmark | mainopt.json | ic2opt.json | Change | Significance | | |
+=========================+==============+=============+==============+========================+ | |
| 2to3 | 296 ms | 296 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| async_generators | 438 ms | 441 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| async_tree_cpu_io_mixed | 803 ms | 816 ms | 1.02x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| async_tree_io | 1.42 sec | 1.36 sec | 1.05x faster | Significant (t=29.60) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| async_tree_memoization | 685 ms | 656 ms | 1.04x faster | Significant (t=18.80) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| async_tree_none | 564 ms | 542 ms | 1.04x faster | Significant (t=9.25) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| bench_mp_pool | 20.3 ms | 19.7 ms | 1.03x faster | Significant (t=2.63) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| bench_thread_pool | 3.44 ms | 3.40 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| chameleon | 6.88 ms | 6.92 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| chaos | 76.9 ms | 75.6 ms | 1.02x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| coroutines | 25.8 ms | 25.5 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| coverage | 81.7 ms | 83.8 ms | 1.03x slower | Significant (t=-9.87) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| crypto_pyaes | 80.8 ms | 79.3 ms | 1.02x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| deepcopy | 379 us | 369 us | 1.03x faster | Significant (t=19.68) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| deepcopy_memo | 37.7 us | 37.0 us | 1.02x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| deepcopy_reduce | 3.42 us | 3.39 us | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| deltablue | 3.54 ms | 3.44 ms | 1.03x faster | Significant (t=12.71) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| docutils | 2.71 sec | 2.71 sec | 1.00x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| dulwich_log | 71.4 ms | 72.2 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| fannkuch | 435 ms | 440 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| float | 84.5 ms | 83.7 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| generators | 32.5 ms | 33.0 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| genshi_text | 23.0 ms | 22.8 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| genshi_xml | 52.0 ms | 52.1 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| go | 146 ms | 146 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| hexiom | 6.69 ms | 6.71 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| html5lib | 64.9 ms | 66.4 ms | 1.02x slower | Significant (t=-2.83) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| json_dumps | 10.4 ms | 10.3 ms | 1.00x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| json_loads | 26.5 us | 26.5 us | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| logging_format | 7.67 us | 7.86 us | 1.02x slower | Significant (t=-7.71) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| logging_silent | 109 ns | 105 ns | 1.04x faster | Significant (t=19.13) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| logging_simple | 7.01 us | 7.22 us | 1.03x slower | Significant (t=-14.73) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| mako | 11.4 ms | 11.4 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| mdp | 2.93 sec | 2.91 sec | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| meteor_contest | 115 ms | 114 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| nbody | 103 ms | 102 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| nqueens | 91.3 ms | 91.6 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pathlib | 23.5 ms | 24.2 ms | 1.03x slower | Significant (t=-9.55) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pickle | 10.9 us | 10.9 us | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pickle_dict | 32.6 us | 32.3 us | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pickle_list | 4.32 us | 4.27 us | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pickle_pure_python | 311 us | 314 us | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pidigits | 210 ms | 211 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pprint_pformat | 1.60 sec | 1.63 sec | 1.02x slower | Significant (t=-17.08) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pprint_safe_repr | 788 ms | 798 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| pyflate | 460 ms | 464 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| python_startup | 23.3 ms | 23.2 ms | 1.00x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| python_startup_no_site | 19.8 ms | 19.6 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| raytrace | 333 ms | 328 ms | 1.02x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| regex_compile | 144 ms | 145 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| regex_dna | 195 ms | 198 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| regex_effbot | 3.52 ms | 3.49 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| regex_v8 | 23.6 ms | 23.0 ms | 1.03x faster | Significant (t=33.55) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| richards | 47.1 ms | 47.4 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| scimark_fft | 373 ms | 378 ms | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| scimark_lu | 126 ms | 128 ms | 1.02x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| scimark_monte_carlo | 73.8 ms | 73.3 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| scimark_sor | 125 ms | 125 ms | 1.00x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| scimark_sparse_mat_mult | 4.83 ms | 4.82 ms | 1.00x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| spectral_norm | 123 ms | 122 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| sqlglot_normalize | 125 ms | 122 ms | 1.03x faster | Significant (t=24.42) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| sqlglot_optimize | 60.4 ms | 59.9 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| sqlglot_parse | 1.63 ms | 1.62 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| sqlglot_transpile | 1.95 ms | 1.93 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| sqlite_synth | 2.89 us | 2.84 us | 1.02x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| telco | 7.08 ms | 7.02 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| tornado_http | 154 ms | 153 ms | 1.01x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| unpack_sequence | 45.0 ns | 45.5 ns | 1.01x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| unpickle | 15.0 us | 14.6 us | 1.03x faster | Significant (t=5.84) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| unpickle_list | 5.53 us | 5.56 us | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| unpickle_pure_python | 234 us | 235 us | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| xml_etree_generate | 95.7 ms | 98.6 ms | 1.03x slower | Significant (t=-15.06) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| xml_etree_iterparse | 111 ms | 109 ms | 1.02x faster | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| xml_etree_parse | 149 ms | 149 ms | 1.00x slower | Not significant | | |
+-------------------------+--------------+-------------+--------------+------------------------+ | |
| xml_etree_process | 66.4 ms | 68.1 ms | 1.03x slower | Significant (t=-12.11) | | |
+-------------------------+--------------+-------------+--------------+------------------------+ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment