Skip to content

Instantly share code, notes, and snippets.

@jeethu

jeethu/pyperformance_comparison

Created January 16, 2018 23:42
Show Gist options
  • Save jeethu/d6e4045f7932136548a806380eddd030 to your computer and use it in GitHub Desktop.
Save jeethu/d6e4045f7932136548a806380eddd030 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pyperformance_comparison
py37_baseline-no-pgo-no-lto.json
================================
Performance version: 0.6.0
Report on Linux-4.13.0-19-generic-x86_64-with-debian-stretch-sid
Number of logical CPUs: 8
Start date: 2018-01-16 21:08:29.457607
End date: 2018-01-16 21:46:10.018098
py37_list_insert_memmove-t32-no-pgo-no-lto.json
===============================================
Performance version: 0.6.0
Report on Linux-4.13.0-19-generic-x86_64-with-debian-stretch-sid
Number of logical CPUs: 8
Start date: 2018-01-16 22:02:11.437850
End date: 2018-01-16 22:38:02.961562
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| Benchmark | py37_baseline-no-pgo-no-lto.json | py37_list_insert_memmove-t32-no-pgo-no-lto.json | Change | Significance |
+=========================+==================================+=================================================+==============+=======================+
| 2to3 | 432 ms | 347 ms | 1.25x faster | Significant (t=34.60) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| chameleon | 15.3 ms | 11.0 ms | 1.39x faster | Significant (t=37.04) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| chaos | 166 ms | 131 ms | 1.27x faster | Significant (t=28.98) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| crypto_pyaes | 155 ms | 124 ms | 1.24x faster | Significant (t=35.12) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| deltablue | 11.4 ms | 9.00 ms | 1.27x faster | Significant (t=34.02) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| django_template | 194 ms | 150 ms | 1.29x faster | Significant (t=27.71) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| dulwich_log | 97.9 ms | 80.8 ms | 1.21x faster | Significant (t=24.88) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| fannkuch | 631 ms | 595 ms | 1.06x faster | Significant (t=7.08) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| float | 148 ms | 147 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| genshi_text | 47.7 ms | 47.2 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| genshi_xml | 96.6 ms | 97.0 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| go | 368 ms | 366 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| hexiom | 14.6 ms | 14.6 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| html5lib | 136 ms | 135 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| json_dumps | 17.5 ms | 17.3 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| json_loads | 36.3 us | 36.5 us | 1.01x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| logging_format | 17.5 us | 17.8 us | 1.02x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| logging_silent | 277 ns | 275 ns | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| logging_simple | 14.4 us | 14.9 us | 1.03x slower | Significant (t=-2.57) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| mako | 25.3 ms | 22.9 ms | 1.10x faster | Significant (t=8.25) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| meteor_contest | 136 ms | 134 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| nbody | 163 ms | 163 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| nqueens | 144 ms | 142 ms | 1.02x faster | Significant (t=1.97) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| pathlib | 27.0 ms | 24.5 ms | 1.11x faster | Significant (t=5.40) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| pickle | 16.1 us | 16.3 us | 1.02x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| pickle_dict | 42.8 us | 43.0 us | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| pickle_list | 6.22 us | 6.36 us | 1.02x slower | Significant (t=-2.48) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| pickle_pure_python | 681 us | 630 us | 1.08x faster | Significant (t=4.44) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| pidigits | 214 ms | 209 ms | 1.02x faster | Significant (t=2.68) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| python_startup | 8.71 ms | 8.50 ms | 1.02x faster | Significant (t=6.21) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| python_startup_no_site | 5.55 ms | 5.55 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| raytrace | 771 ms | 637 ms | 1.21x faster | Significant (t=18.42) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| regex_compile | 265 ms | 215 ms | 1.23x faster | Significant (t=19.32) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| regex_dna | 190 ms | 166 ms | 1.15x faster | Significant (t=23.97) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| regex_effbot | 3.78 ms | 2.97 ms | 1.27x faster | Significant (t=34.19) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| regex_v8 | 23.1 ms | 23.5 ms | 1.02x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| richards | 89.2 ms | 91.9 ms | 1.03x slower | Significant (t=-4.13) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| scimark_fft | 355 ms | 365 ms | 1.03x slower | Significant (t=-3.97) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| scimark_lu | 202 ms | 205 ms | 1.02x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| scimark_monte_carlo | 118 ms | 118 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| scimark_sor | 219 ms | 220 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| scimark_sparse_mat_mult | 4.14 ms | 4.15 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| spectral_norm | 139 ms | 143 ms | 1.03x slower | Significant (t=-3.62) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sqlalchemy_declarative | 166 ms | 166 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sqlalchemy_imperative | 32.5 ms | 32.4 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sqlite_synth | 2.70 us | 2.68 us | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sympy_expand | 449 ms | 446 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sympy_integrate | 22.2 ms | 22.2 ms | 1.00x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sympy_str | 200 ms | 200 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| sympy_sum | 96.1 ms | 96.1 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| telco | 7.35 ms | 7.19 ms | 1.02x faster | Significant (t=5.80) |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| tornado_http | 196 ms | 197 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| unpack_sequence | 50.4 ns | 49.4 ns | 1.02x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| unpickle | 15.7 us | 15.8 us | 1.01x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| unpickle_list | 4.71 us | 4.77 us | 1.01x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| unpickle_pure_python | 437 us | 439 us | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| xml_etree_generate | 119 ms | 120 ms | 1.01x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| xml_etree_iterparse | 109 ms | 110 ms | 1.00x slower | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| xml_etree_parse | 147 ms | 146 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
| xml_etree_process | 97.3 ms | 96.4 ms | 1.01x faster | Not significant |
+-------------------------+----------------------------------+-------------------------------------------------+--------------+-----------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment