Skip to content

Instantly share code, notes, and snippets.

@msarahan

msarahan/gist:056267fff04ef7d04fb1a4894a69d804

Created January 8, 2018 22:08
Show Gist options
  • Save msarahan/056267fff04ef7d04fb1a4894a69d804 to your computer and use it in GitHub Desktop.
Save msarahan/056267fff04ef7d04fb1a4894a69d804 to your computer and use it in GitHub Desktop.
Download ZIP
Benchmark results
Raw
gistfile1.txt
Domino Python 3.6 image
+-------------------------+----------+-------------------------------+--------------------------------+
| Benchmark | pip3 | anaconda3 | intel3 |
+=========================+==========+===============================+================================+
| 2to3 | 1.11 sec | not significant | 1.63 sec: 1.46x slower (+46%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| chameleon | 46.1 ms | 22.8 ms: 2.02x faster (-50%) | 54.7 ms: 1.19x slower (+19%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| chaos | 484 ms | 251 ms: 1.93x faster (-48%) | 610 ms: 1.26x slower (+26%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| crypto_pyaes | 301 ms | 222 ms: 1.36x faster (-26%) | 527 ms: 1.75x slower (+75%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| deltablue | 20.6 ms | 16.9 ms: 1.22x faster (-18%) | 40.9 ms: 1.98x slower (+98%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| django_template | 356 ms | 324 ms: 1.10x faster (-9%) | 826 ms: 2.32x slower (+132%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| dulwich_log | 196 ms | 163 ms: 1.20x faster (-17%) | 349 ms: 1.78x slower (+78%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| fannkuch | 1.07 sec | 1.32 sec: 1.23x slower (+23%) | 2.29 sec: 2.13x slower (+113%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| float | 266 ms | 413 ms: 1.56x slower (+56%) | 541 ms: 2.04x slower (+104%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| genshi_text | 87.2 ms | 117 ms: 1.34x slower (+34%) | 162 ms: 1.86x slower (+86%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| genshi_xml | 179 ms | not significant | 363 ms: 2.03x slower (+103%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| go | 1.05 sec | 971 ms: 1.09x faster (-8%) | 1.29 sec: 1.22x slower (+22%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| hexiom | 43.4 ms | not significant | 54.4 ms: 1.25x slower (+25%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| html5lib | 264 ms | 202 ms: 1.31x faster (-24%) | 474 ms: 1.80x slower (+80%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| json_dumps | 48.2 ms | 32.8 ms: 1.47x faster (-32%) | 55.6 ms: 1.15x slower (+15%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| json_loads | 96.2 us | not significant | 117 us: 1.22x slower (+22%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| logging_format | 50.1 us | 46.7 us: 1.07x faster (-7%) | 64.8 us: 1.29x slower (+29%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| logging_silent | 1.43 us | 1.28 us: 1.12x faster (-11%) | 1.63 us: 1.14x slower (+14%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| logging_simple | 41.0 us | 38.8 us: 1.06x faster (-5%) | 53.1 us: 1.29x slower (+29%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| mako | 85.5 ms | 64.0 ms: 1.34x faster (-25%) | 101 ms: 1.18x slower (+18%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| meteor_contest | 278 ms | 328 ms: 1.18x slower (+18%) | 410 ms: 1.47x slower (+47%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| nbody | 259 ms | 450 ms: 1.73x slower (+73%) | 548 ms: 2.11x slower (+111%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| nqueens | 243 ms | 332 ms: 1.37x slower (+37%) | 516 ms: 2.12x slower (+112%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| pathlib | 60.0 ms | 77.0 ms: 1.28x slower (+28%) | 115 ms: 1.91x slower (+91%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| pickle | 24.6 us | 34.4 us: 1.40x slower (+40%) | 48.5 us: 1.97x slower (+97%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| pickle_dict | 70.8 us | 90.7 us: 1.28x slower (+28%) | 134 us: 1.89x slower (+89%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| pickle_list | 10.2 us | not significant | 18.1 us: 1.77x slower (+77%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| pickle_pure_python | 1.31 ms | 1.73 ms: 1.32x slower (+32%) | 2.59 ms: 1.97x slower (+97%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| pidigits | 325 ms | 460 ms: 1.42x slower (+42%) | 615 ms: 1.89x slower (+89%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| python_startup | 27.0 ms | 36.7 ms: 1.36x slower (+36%) | 58.9 ms: 2.18x slower (+118%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| python_startup_no_site | 24.3 ms | 28.4 ms: 1.17x slower (+17%) | 38.5 ms: 1.58x slower (+58%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| raytrace | 2.53 sec | 1.81 sec: 1.40x faster (-29%) | 2.96 sec: 1.17x slower (+17%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| regex_compile | 766 ms | 679 ms: 1.13x faster (-11%) | 947 ms: 1.24x slower (+24%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| regex_dna | 473 ms | 436 ms: 1.08x faster (-8%) | 523 ms: 1.11x slower (+11%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| regex_effbot | 6.04 ms | 9.59 ms: 1.59x slower (+59%) | 9.91 ms: 1.64x slower (+64%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| regex_v8 | 71.4 ms | 84.5 ms: 1.18x slower (+18%) | 85.9 ms: 1.20x slower (+20%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| richards | 330 ms | not significant | 408 ms: 1.24x slower (+24%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| scimark_fft | 1.17 sec | 1.29 sec: 1.10x slower (+10%) | 1.50 sec: 1.28x slower (+28%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| scimark_lu | 829 ms | 996 ms: 1.20x slower (+20%) | 1.19 sec: 1.44x slower (+44%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| scimark_monte_carlo | 429 ms | 453 ms: 1.06x slower (+6%) | 542 ms: 1.26x slower (+26%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| scimark_sor | 817 ms | 882 ms: 1.08x slower (+8%) | 1.11 sec: 1.35x slower (+35%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| scimark_sparse_mat_mult | 8.30 ms | 17.6 ms: 2.12x slower (+112%) | 19.2 ms: 2.32x slower (+132%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| spectral_norm | 300 ms | 559 ms: 1.86x slower (+86%) | 634 ms: 2.11x slower (+111%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sqlalchemy_declarative | 361 ms | 573 ms: 1.59x slower (+59%) | 608 ms: 1.68x slower (+68%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sqlalchemy_imperative | 74.1 ms | 113 ms: 1.53x slower (+53%) | 124 ms: 1.68x slower (+68%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sqlite_synth | 7.87 us | 9.90 us: 1.26x slower (+26%) | 12.5 us: 1.58x slower (+58%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sympy_expand | 1.01 sec | 1.84 sec: 1.82x slower (+82%) | 2.10 sec: 2.09x slower (+109%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sympy_integrate | 63.5 ms | 88.2 ms: 1.39x slower (+39%) | 100 ms: 1.58x slower (+58%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sympy_sum | 351 ms | 389 ms: 1.11x slower (+11%) | 423 ms: 1.20x slower (+20%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| sympy_str | 520 ms | 813 ms: 1.57x slower (+57%) | 981 ms: 1.89x slower (+89%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| telco | 15.3 ms | 25.8 ms: 1.69x slower (+69%) | 32.3 ms: 2.11x slower (+111%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| tornado_http | 466 ms | 715 ms: 1.53x slower (+53%) | 865 ms: 1.85x slower (+85%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| unpack_sequence | 105 ns | 161 ns: 1.53x slower (+53%) | 183 ns: 1.75x slower (+75%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| unpickle | 33.2 us | 53.5 us: 1.61x slower (+61%) | 65.8 us: 1.98x slower (+98%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| unpickle_list | 8.19 us | 12.9 us: 1.58x slower (+58%) | 15.7 us: 1.92x slower (+92%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| unpickle_pure_python | 998 us | 1.56 ms: 1.57x slower (+57%) | 1.96 ms: 1.96x slower (+96%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| xml_etree_parse | 299 ms | 471 ms: 1.57x slower (+57%) | 568 ms: 1.90x slower (+90%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| xml_etree_iterparse | 268 ms | 420 ms: 1.57x slower (+57%) | 501 ms: 1.86x slower (+86%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| xml_etree_generate | 269 ms | 442 ms: 1.64x slower (+64%) | 536 ms: 1.99x slower (+99%) |
+-------------------------+----------+-------------------------------+--------------------------------+
| xml_etree_process | 238 ms | 357 ms: 1.50x slower (+50%) | 446 ms: 1.87x slower (+87%) |
+-------------------------+----------+-------------------------------+--------------------------------+
@msarahan
Copy link
Author

msarahan commented Jan 9, 2018 

+-------------------------+----------+-------------------------------+-------------------------------+
| Benchmark               | pip3     | anaconda3                     | intel3                        |
+=========================+==========+===============================+===============================+
| 2to3                    | 1.31 sec | 1.23 sec: 1.07x faster (-7%)  | 1.44 sec: 1.10x slower (+10%) |
+-------------------------+----------+-------------------------------+-------------------------------+
| chameleon               | 46.0 ms  | 41.3 ms: 1.12x faster (-10%)  | 51.1 ms: 1.11x slower (+11%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| chaos                   | 508 ms   | 467 ms: 1.09x faster (-8%)    | 574 ms: 1.13x slower (+13%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| crypto_pyaes            | 434 ms   | 425 ms: 1.02x faster (-2%)    | 493 ms: 1.14x slower (+14%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| deltablue               | 35.1 ms  | 31.1 ms: 1.13x faster (-11%)  | 39.1 ms: 1.11x slower (+11%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| django_template         | 673 ms   | 604 ms: 1.11x faster (-10%)   | 762 ms: 1.13x slower (+13%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| dulwich_log             | 275 ms   | 254 ms: 1.08x faster (-7%)    | 307 ms: 1.12x slower (+12%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| fannkuch                | 1.95 sec | 1.81 sec: 1.07x faster (-7%)  | 2.10 sec: 1.08x slower (+8%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| float                   | 447 ms   | 420 ms: 1.06x faster (-6%)    | 493 ms: 1.10x slower (+10%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| genshi_text             | 144 ms   | 128 ms: 1.12x faster (-11%)   | 156 ms: 1.09x slower (+9%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| genshi_xml              | 295 ms   | 269 ms: 1.10x faster (-9%)    | 331 ms: 1.12x slower (+12%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| go                      | 1.12 sec | 1.00 sec: 1.12x faster (-11%) | 1.22 sec: 1.09x slower (+9%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| hexiom                  | 47.2 ms  | 43.6 ms: 1.08x faster (-8%)   | 52.2 ms: 1.10x slower (+10%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| html5lib                | 386 ms   | 358 ms: 1.08x faster (-7%)    | 435 ms: 1.13x slower (+13%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| json_dumps              | 50.8 ms  | 44.6 ms: 1.14x faster (-12%)  | 53.5 ms: 1.05x slower (+5%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| json_loads              | 107 us   | 96.6 us: 1.11x faster (-10%)  | 110 us: 1.03x slower (+3%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| logging_format          | 53.7 us  | 47.7 us: 1.13x faster (-11%)  | 60.1 us: 1.12x slower (+12%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| logging_silent          | 1.51 us  | 1.32 us: 1.14x faster (-13%)  | 1.63 us: 1.08x slower (+8%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| logging_simple          | 44.6 us  | 40.6 us: 1.10x faster (-9%)   | 50.9 us: 1.14x slower (+14%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| mako                    | 89.8 ms  | 78.0 ms: 1.15x faster (-13%)  | 97.4 ms: 1.09x slower (+9%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| meteor_contest          | 371 ms   | 337 ms: 1.10x faster (-9%)    | 389 ms: 1.05x slower (+5%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| nbody                   | 472 ms   | not significant               | 513 ms: 1.09x slower (+9%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| nqueens                 | 433 ms   | 389 ms: 1.11x faster (-10%)   | 481 ms: 1.11x slower (+11%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| pathlib                 | 99.6 ms  | 91.3 ms: 1.09x faster (-8%)   | 109 ms: 1.10x slower (+10%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| pickle                  | 45.5 us  | 36.0 us: 1.26x faster (-21%)  | 47.3 us: 1.04x slower (+4%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| pickle_dict             | 121 us   | 94.1 us: 1.29x faster (-22%)  | 133 us: 1.10x slower (+10%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| pickle_list             | 16.9 us  | 13.0 us: 1.30x faster (-23%)  | not significant               |
+-------------------------+----------+-------------------------------+-------------------------------+
| pickle_pure_python      | 2.21 ms  | 1.98 ms: 1.12x faster (-11%)  | 2.47 ms: 1.12x slower (+12%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| pidigits                | 577 ms   | 482 ms: 1.20x faster (-17%)   | not significant               |
+-------------------------+----------+-------------------------------+-------------------------------+
| python_startup          | 40.2 ms  | not significant               | 45.0 ms: 1.12x slower (+12%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| python_startup_no_site  | 26.4 ms  | not significant               | 28.9 ms: 1.10x slower (+10%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| raytrace                | 2.51 sec | 2.25 sec: 1.11x faster (-10%) | 2.80 sec: 1.12x slower (+12%) |
+-------------------------+----------+-------------------------------+-------------------------------+
| regex_compile           | 785 ms   | 714 ms: 1.10x faster (-9%)    | 881 ms: 1.12x slower (+12%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| regex_dna               | 458 ms   | 434 ms: 1.06x faster (-5%)    | 477 ms: 1.04x slower (+4%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| regex_effbot            | 8.65 ms  | 9.18 ms: 1.06x slower (+6%)   | 9.52 ms: 1.10x slower (+10%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| regex_v8                | 77.4 ms  | 80.6 ms: 1.04x slower (+4%)   | 82.1 ms: 1.06x slower (+6%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| richards                | 353 ms   | 306 ms: 1.15x faster (-13%)   | 394 ms: 1.12x slower (+12%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| scimark_fft             | 1.26 sec | not significant               | 1.38 sec: 1.10x slower (+10%) |
+-------------------------+----------+-------------------------------+-------------------------------+
| scimark_lu              | 1.00 sec | 907 ms: 1.10x faster (-9%)    | 1.10 sec: 1.09x slower (+9%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| scimark_monte_carlo     | 460 ms   | 426 ms: 1.08x faster (-7%)    | 511 ms: 1.11x slower (+11%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| scimark_sor             | 944 ms   | 840 ms: 1.12x faster (-11%)   | 1.04 sec: 1.10x slower (+10%) |
+-------------------------+----------+-------------------------------+-------------------------------+
| scimark_sparse_mat_mult | 16.6 ms  | 17.1 ms: 1.03x slower (+3%)   | 18.2 ms: 1.10x slower (+10%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| spectral_norm           | 525 ms   | 557 ms: 1.06x slower (+6%)    | 571 ms: 1.09x slower (+9%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| sqlalchemy_declarative  | 542 ms   | not significant               | 577 ms: 1.06x slower (+6%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| sqlalchemy_imperative   | 107 ms   | 99.1 ms: 1.08x faster (-8%)   | 114 ms: 1.06x slower (+6%)    |
+-------------------------+----------+-------------------------------+-------------------------------+
| sqlite_synth            | 13.0 us  | 9.69 us: 1.34x faster (-25%)  | 11.9 us: 1.09x faster (-9%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| sympy_expand            | 1.82 sec | 1.66 sec: 1.09x faster (-8%)  | 2.02 sec: 1.11x slower (+11%) |
+-------------------------+----------+-------------------------------+-------------------------------+
| sympy_integrate         | 82.6 ms  | 77.4 ms: 1.07x faster (-6%)   | 90.1 ms: 1.09x slower (+9%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| sympy_sum               | 359 ms   | 332 ms: 1.08x faster (-7%)    | 402 ms: 1.12x slower (+12%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| sympy_str               | 808 ms   | 732 ms: 1.10x faster (-9%)    | 890 ms: 1.10x slower (+10%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| telco                   | 28.3 ms  | 25.2 ms: 1.13x faster (-11%)  | 31.7 ms: 1.12x slower (+12%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| tornado_http            | 673 ms   | 642 ms: 1.05x faster (-5%)    | 754 ms: 1.12x slower (+12%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| unpack_sequence         | 170 ns   | 144 ns: 1.18x faster (-16%)   | not significant               |
+-------------------------+----------+-------------------------------+-------------------------------+
| unpickle                | 60.0 us  | 49.7 us: 1.21x faster (-17%)  | 63.2 us: 1.05x slower (+5%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| unpickle_list           | 14.8 us  | 12.1 us: 1.22x faster (-18%)  | 15.2 us: 1.02x slower (+2%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| unpickle_pure_python    | 1.69 ms  | 1.47 ms: 1.15x faster (-13%)  | 1.88 ms: 1.11x slower (+11%)  |
+-------------------------+----------+-------------------------------+-------------------------------+
| xml_etree_parse         | 457 ms   | 424 ms: 1.08x faster (-7%)    | 514 ms: 1.13x slower (+13%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| xml_etree_iterparse     | 401 ms   | 387 ms: 1.04x faster (-4%)    | 452 ms: 1.13x slower (+13%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| xml_etree_generate      | 456 ms   | 412 ms: 1.11x faster (-10%)   | 514 ms: 1.13x slower (+13%)   |
+-------------------------+----------+-------------------------------+-------------------------------+
| xml_etree_process       | 385 ms   | 346 ms: 1.11x faster (-10%)   | 423 ms: 1.10x slower (+10%)   |
+-------------------------+----------+-------------------------------+-------------------------------+

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment