pypy2 comparison to unitcode-utf8

gistfile1.txt

I ran the python performance suite (not our benchmark suite) 3 times for each pypy2 latest nightly and pypy2
on the unicode-utf8 branch

for i in `seq 1 3`; do pyperformance run --python=pypy-c-jit-95546-0679f7b21b79-linux64/bin/pypy -o pypy2_$i.json; done

for i in `seq 1 3`; do pyperformance run --python=pypy-c-jit-95565-26a182fd648c-linux64/bin/pypy -o pypy2_utf8$i.json; done

python -mperf compare_to pypy2*.json

2to3
====

Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy2_2] 1.77 sec +- 0.05 sec: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy2_3] 1.76 sec +- 0.04 sec: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy2_utf81] 1.85 sec +- 0.05 sec: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy2_utf82] 1.84 sec +- 0.04 sec: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy2_utf83] 1.83 sec +- 0.05 sec: 1.02x slower (+2%)

chameleon
=========

Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy2_2] 6.48 ms +- 0.11 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy2_3] 6.48 ms +- 0.09 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy2_utf81] 6.09 ms +- 0.14 ms: 1.06x faster (-6%)
Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy2_utf82] 6.08 ms +- 0.09 ms: 1.07x faster (-6%)
Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy2_utf83] 6.11 ms +- 0.12 ms: 1.06x faster (-6%)

chaos
=====

Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy2_2] 5.71 ms +- 0.07 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy2_3] 5.73 ms +- 0.06 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy2_utf81] 5.76 ms +- 0.03 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy2_utf82] 5.77 ms +- 0.06 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy2_utf83] 5.74 ms +- 0.06 ms: 1.00x faster (-0%)

crypto_pyaes
============

Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy2_2] 11.0 ms +- 0.2 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy2_3] 10.9 ms +- 0.2 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy2_utf81] 10.7 ms +- 0.2 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy2_utf82] 10.9 ms +- 0.2 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy2_utf83] 10.8 ms +- 0.2 ms: 1.02x faster (-2%)

deltablue
=========

Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy2_2] 385 us +- 7 us: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy2_3] 387 us +- 7 us: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy2_utf81] 385 us +- 5 us: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy2_utf82] 384 us +- 7 us: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy2_utf83] 384 us +- 7 us: 1.02x faster (-2%)

django_template
===============

Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy2_2] 34.1 ms +- 1.6 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy2_3] 33.9 ms +- 1.5 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy2_utf81] 19.9 ms +- 0.9 ms: 1.72x faster (-42%)
Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy2_utf82] 20.0 ms +- 0.9 ms: 1.71x faster (-42%)
Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy2_utf83] 19.8 ms +- 0.8 ms: 1.73x faster (-42%)

dulwich_log
===========

Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy2_2] 135 ms +- 2 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy2_3] 134 ms +- 2 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy2_utf81] 135 ms +- 3 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy2_utf82] 134 ms +- 4 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy2_utf83] 132 ms +- 3 ms: 1.02x faster (-2%)

fannkuch
========

Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy2_2] 139 ms +- 1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy2_3] 139 ms +- 1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy2_utf81] 139 ms +- 1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy2_utf82] 140 ms +- 2 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy2_utf83] 139 ms +- 1 ms: 1.00x slower (+0%)

float
=====

Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy2_2] 31.8 ms +- 1.0 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy2_3] 31.9 ms +- 1.1 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy2_utf81] 32.3 ms +- 1.1 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy2_utf82] 32.6 ms +- 1.1 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy2_utf83] 32.4 ms +- 1.1 ms: 1.02x slower (+2%)

go
==

Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy2_2] 93.3 ms +- 3.9 ms: 1.07x faster (-7%)
Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy2_3] 101 ms +- 7 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy2_utf81] 68.6 ms +- 2.4 ms: 1.46x faster (-32%)
Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy2_utf82] 68.7 ms +- 2.4 ms: 1.46x faster (-31%)
Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy2_utf83] 70.2 ms +- 2.3 ms: 1.43x faster (-30%)

hg_startup
==========

Mean +- std dev: [pypy2_1] 218 ms +- 1 ms -> [pypy2_2] 218 ms +- 1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 218 ms +- 1 ms -> [pypy2_3] 218 ms +- 1 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 218 ms +- 1 ms -> [pypy2_utf81] 219 ms +- 1 ms: 1.00x slower (+0%)
Mean +- std dev: [pypy2_1] 218 ms +- 1 ms -> [pypy2_utf82] 220 ms +- 1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 218 ms +- 1 ms -> [pypy2_utf83] 219 ms +- 1 ms: 1.01x slower (+1%)

html5lib
========

Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy2_2] 60.5 ms +- 3.8 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy2_3] 60.9 ms +- 3.7 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy2_utf81] 60.1 ms +- 3.7 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy2_utf82] 58.0 ms +- 3.8 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy2_utf83] 56.7 ms +- 3.6 ms: 1.05x faster (-5%)

json_dumps
==========

Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy2_2] 6.10 ms +- 0.07 ms: 1.00x slower (+0%)
Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy2_3] 6.08 ms +- 0.09 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy2_utf81] 6.20 ms +- 0.04 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy2_utf82] 6.20 ms +- 0.06 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy2_utf83] 6.20 ms +- 0.06 ms: 1.02x slower (+2%)

json_loads
==========

Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy2_2] 21.9 us +- 0.3 us: 1.00x slower (+0%)
Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy2_3] 22.1 us +- 0.4 us: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy2_utf81] 25.6 us +- 0.1 us: 1.17x slower (+17%)
Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy2_utf82] 25.6 us +- 0.2 us: 1.17x slower (+17%)
Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy2_utf83] 25.7 us +- 0.4 us: 1.18x slower (+18%)

logging_format
==============

Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy2_2] 5.54 us +- 0.18 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy2_3] 5.54 us +- 0.17 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy2_utf81] 5.35 us +- 0.17 us: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy2_utf82] 5.32 us +- 0.16 us: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy2_utf83] 5.33 us +- 0.18 us: 1.04x faster (-4%)

logging_simple
==============

Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy2_2] 3.31 us +- 0.10 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy2_3] 3.33 us +- 0.09 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy2_utf81] 3.20 us +- 0.08 us: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy2_utf82] 3.18 us +- 0.08 us: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy2_utf83] 3.23 us +- 0.08 us: 1.03x faster (-3%)

meteor_contest
==============

Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy2_2] 63.7 ms +- 1.3 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy2_3] 63.1 ms +- 0.4 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy2_utf81] 63.1 ms +- 0.6 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy2_utf82] 63.1 ms +- 1.1 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy2_utf83] 63.5 ms +- 1.3 ms: 1.00x faster (-0%)
Not significant!

nbody
=====

Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy2_2] 28.6 ms +- 0.1 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy2_3] 28.9 ms +- 0.3 ms: 1.00x slower (+0%)
Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy2_utf81] 28.4 ms +- 0.1 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy2_utf82] 28.5 ms +- 0.2 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy2_utf83] 28.6 ms +- 0.2 ms: 1.01x faster (-1%)

nqueens
=======

Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy2_2] 29.4 ms +- 0.2 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy2_3] 29.5 ms +- 0.4 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy2_utf81] 29.1 ms +- 0.3 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy2_utf82] 29.0 ms +- 0.1 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy2_utf83] 29.0 ms +- 0.1 ms: 1.02x faster (-2%)

pathlib
=======

Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy2_2] 25.8 ms +- 2.0 ms: 1.05x faster (-5%)
Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy2_3] 25.7 ms +- 1.9 ms: 1.06x faster (-6%)
Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy2_utf81] 25.8 ms +- 1.0 ms: 1.06x faster (-5%)
Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy2_utf82] 26.4 ms +- 0.4 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy2_utf83] 25.3 ms +- 2.8 ms: 1.08x faster (-7%)

pickle
======

Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy2_2] 54.2 us +- 0.9 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy2_3] 54.2 us +- 0.9 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy2_utf81] 53.4 us +- 0.9 us: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy2_utf82] 53.9 us +- 1.3 us: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy2_utf83] 53.6 us +- 0.9 us: 1.01x faster (-1%)

pickle_list
===========

Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy2_2] 33.4 us +- 0.6 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy2_3] 33.8 us +- 0.5 us: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy2_utf81] 33.3 us +- 0.5 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy2_utf82] 34.3 us +- 1.3 us: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy2_utf83] 33.6 us +- 0.6 us: 1.01x slower (+1%)
Not significant!

pickle_pure_python
==================

Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy2_2] 54.1 us +- 1.0 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy2_3] 54.2 us +- 0.9 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy2_utf81] 53.8 us +- 1.0 us: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy2_utf82] 53.6 us +- 0.9 us: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy2_utf83] 53.7 us +- 1.0 us: 1.01x faster (-1%)

pidigits
========

Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy2_2] 242 ms +- 2 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy2_3] 241 ms +- 2 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy2_utf81] 236 ms +- 2 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy2_utf82] 237 ms +- 3 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy2_utf83] 237 ms +- 2 ms: 1.02x faster (-2%)

pyflate
=======

Mean +- std dev: [pypy2_1] 264 ms +- 3 ms -> [pypy2_2] 263 ms +- 3 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 264 ms +- 3 ms -> [pypy2_3] 265 ms +- 2 ms: 1.00x slower (+0%)
Mean +- std dev: [pypy2_1] 264 ms +- 3 ms -> [pypy2_utf81] 260 ms +- 2 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 264 ms +- 3 ms -> [pypy2_utf82] 259 ms +- 1 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 264 ms +- 3 ms -> [pypy2_utf83] 259 ms +- 2 ms: 1.02x faster (-2%)

python_startup
==============

Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy2_2] 21.8 ms +- 1.5 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy2_3] 21.8 ms +- 1.4 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy2_utf81] 21.1 ms +- 1.2 ms: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy2_utf82] 21.3 ms +- 1.3 ms: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy2_utf83] 20.9 ms +- 1.4 ms: 1.06x faster (-5%)

python_startup_no_site
======================

Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy2_2] 20.2 ms +- 1.1 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy2_3] 20.1 ms +- 1.3 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy2_utf81] 19.6 ms +- 1.1 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy2_utf82] 19.6 ms +- 1.3 ms: 1.02x faster (-2%)
Not significant!
Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy2_utf83] 19.5 ms +- 1.3 ms: 1.03x faster (-3%)

raytrace
========

Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy2_2] 14.4 ms +- 0.2 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy2_3] 14.3 ms +- 0.1 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy2_utf81] 14.4 ms +- 0.3 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy2_utf82] 14.3 ms +- 0.1 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy2_utf83] 14.4 ms +- 0.3 ms: 1.00x slower (+0%)
Not significant!

regex_compile
=============

Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy2_2] 63.6 ms +- 1.7 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy2_3] 62.9 ms +- 1.7 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy2_utf81] 56.9 ms +- 2.0 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy2_utf82] 56.4 ms +- 1.7 ms: 1.11x faster (-10%)
Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy2_utf83] 56.4 ms +- 1.7 ms: 1.11x faster (-10%)

regex_dna
=========

Mean +- std dev: [pypy2_1] 99.8 ms +- 1.0 ms -> [pypy2_2] 99.8 ms +- 1.0 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 99.8 ms +- 1.0 ms -> [pypy2_3] 99.9 ms +- 1.1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 99.8 ms +- 1.0 ms -> [pypy2_utf81] 100 ms +- 1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 99.8 ms +- 1.0 ms -> [pypy2_utf82] 100 ms +- 1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 99.8 ms +- 1.0 ms -> [pypy2_utf83] 100 ms +- 1 ms: 1.01x slower (+1%)

regex_effbot
============

Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy2_2] 2.50 ms +- 0.01 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy2_3] 2.54 ms +- 0.05 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy2_utf81] 2.62 ms +- 0.01 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy2_utf82] 2.61 ms +- 0.02 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy2_utf83] 2.64 ms +- 0.07 ms: 1.05x slower (+5%)

regex_v8
========

Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy2_2] 20.9 ms +- 0.3 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy2_3] 20.7 ms +- 0.2 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy2_utf81] 19.7 ms +- 0.2 ms: 1.05x faster (-5%)
Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy2_utf82] 20.3 ms +- 0.3 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy2_utf83] 20.4 ms +- 0.2 ms: 1.02x faster (-2%)

richards
========

Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy2_2] 5.00 ms +- 0.09 ms: 1.18x faster (-15%)
Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy2_3] 6.15 ms +- 0.15 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy2_utf81] 5.99 ms +- 0.17 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy2_utf82] 5.91 ms +- 0.16 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy2_utf83] 5.97 ms +- 0.14 ms: 1.01x slower (+1%)

scimark_fft
===========

Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy2_2] 10.8 ms +- 0.1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy2_3] 10.8 ms +- 0.1 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy2_utf81] 10.8 ms +- 0.1 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy2_utf82] 10.8 ms +- 0.1 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy2_utf83] 10.7 ms +- 0.0 ms: 1.01x faster (-1%)

scimark_lu
==========

Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy2_2] 1.95 ms +- 0.03 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy2_3] 1.94 ms +- 0.01 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy2_utf81] 1.94 ms +- 0.01 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy2_utf82] 1.95 ms +- 0.04 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy2_utf83] 1.96 ms +- 0.03 ms: 1.01x slower (+1%)

scimark_monte_carlo
===================

Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy2_2] 3.37 ms +- 0.02 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy2_3] 3.27 ms +- 0.03 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy2_utf81] 3.24 ms +- 0.01 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy2_utf82] 3.25 ms +- 0.02 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy2_utf83] 3.26 ms +- 0.02 ms: 1.00x slower (+0%)
Not significant!

scimark_sor
===========

Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy2_2] 1.11 ms +- 0.02 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy2_3] 1.08 ms +- 0.02 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy2_utf81] 1.07 ms +- 0.02 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy2_utf82] 1.07 ms +- 0.02 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy2_utf83] 1.07 ms +- 0.02 ms: 1.00x faster (-0%)
Not significant!

scimark_sparse_mat_mult
=======================

Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy2_2] 169 us +- 4 us: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy2_3] 166 us +- 2 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy2_utf81] 165 us +- 1 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy2_utf82] 166 us +- 2 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy2_utf83] 166 us +- 2 us: 1.00x faster (-0%)
Not significant!

spambayes
=========

Mean +- std dev: [pypy2_1] 46.6 ms +- 1.3 ms -> [pypy2_2] 46.1 ms +- 0.9 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 46.6 ms +- 1.3 ms -> [pypy2_3] 54.8 ms +- 4.6 ms: 1.17x slower (+17%)
Mean +- std dev: [pypy2_1] 46.6 ms +- 1.3 ms -> [pypy2_utf81] 45.8 ms +- 1.2 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 46.6 ms +- 1.3 ms -> [pypy2_utf82] 46.1 ms +- 1.4 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 46.6 ms +- 1.3 ms -> [pypy2_utf83] 46.1 ms +- 1.2 ms: 1.01x faster (-1%)

spectral_norm
=============

Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy2_2] 6.96 ms +- 0.12 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy2_3] 6.94 ms +- 0.08 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy2_utf81] 6.89 ms +- 0.02 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy2_utf82] 6.90 ms +- 0.03 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy2_utf83] 6.93 ms +- 0.12 ms: 1.00x slower (+0%)
Not significant!

sqlalchemy_declarative
======================

Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy2_2] 183 ms +- 10 ms: 1.02x slower (+2%)
Not significant!
Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy2_3] 175 ms +- 10 ms: 1.03x faster (-2%)
Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy2_utf81] 179 ms +- 11 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy2_utf82] 181 ms +- 12 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy2_utf83] 182 ms +- 10 ms: 1.01x slower (+1%)
Not significant!

sqlite_synth
============

Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy2_2] 4.47 us +- 0.09 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy2_3] 4.48 us +- 0.08 us: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy2_utf81] 4.29 us +- 0.08 us: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy2_utf82] 4.28 us +- 0.09 us: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy2_utf83] 4.25 us +- 0.08 us: 1.05x faster (-5%)

sympy_expand
============

Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy2_2] 234 ms +- 1 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy2_3] 236 ms +- 3 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy2_utf81] 231 ms +- 2 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy2_utf82] 232 ms +- 2 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy2_utf83] 231 ms +- 2 ms: 1.02x faster (-2%)

sympy_integrate
===============

Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy2_2] 41.8 ms +- 3.8 ms: 1.10x slower (+10%)
Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy2_3] 41.1 ms +- 3.3 ms: 1.08x slower (+8%)
Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy2_utf81] 42.6 ms +- 3.8 ms: 1.12x slower (+12%)
Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy2_utf82] 40.9 ms +- 4.9 ms: 1.08x slower (+8%)
Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy2_utf83] 37.6 ms +- 3.3 ms: 1.01x faster (-1%)
Not significant!

sympy_sum
=========

Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy2_2] 116 ms +- 6 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy2_3] 123 ms +- 8 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy2_utf81] 124 ms +- 9 ms: 1.02x faster (-2%)
Not significant!
Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy2_utf82] 123 ms +- 8 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy2_utf83] 134 ms +- 14 ms: 1.06x slower (+6%)

sympy_str
=========

Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy2_2] 109 ms +- 5 ms: 1.06x faster (-6%)
Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy2_3] 112 ms +- 6 ms: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy2_utf81] 106 ms +- 6 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy2_utf82] 111 ms +- 7 ms: 1.05x faster (-5%)
Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy2_utf83] 126 ms +- 7 ms: 1.09x slower (+9%)

telco
=====

Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy2_2] 18.8 ms +- 0.4 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy2_3] 18.9 ms +- 0.4 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy2_utf81] 18.4 ms +- 0.4 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy2_utf82] 18.4 ms +- 0.4 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy2_utf83] 18.3 ms +- 0.4 ms: 1.03x faster (-3%)

tornado_http
============

Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy2_2] 243 ms +- 9 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy2_3] 237 ms +- 8 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy2_utf81] 234 ms +- 10 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy2_utf82] 236 ms +- 9 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy2_utf83] 234 ms +- 9 ms: 1.02x faster (-2%)

unpickle
========

Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy2_2] 47.6 us +- 0.5 us: 1.00x slower (+0%)
Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy2_3] 47.3 us +- 0.2 us: 1.00x faster (-0%)
Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy2_utf81] 48.0 us +- 1.0 us: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy2_utf82] 47.6 us +- 0.9 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy2_utf83] 47.7 us +- 0.9 us: 1.01x slower (+1%)

unpickle_list
=============

Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy2_2] 18.0 us +- 0.2 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy2_3] 18.0 us +- 0.2 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy2_utf81] 17.8 us +- 0.3 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy2_utf82] 17.7 us +- 0.2 us: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy2_utf83] 17.7 us +- 0.2 us: 1.01x faster (-1%)

xml_etree_parse
===============

Mean +- std dev: [pypy2_1] 582 ms +- 7 ms -> [pypy2_2] 584 ms +- 7 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 582 ms +- 7 ms -> [pypy2_3] 583 ms +- 7 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy2_1] 582 ms +- 7 ms -> [pypy2_utf81] 526 ms +- 6 ms: 1.11x faster (-10%)
Mean +- std dev: [pypy2_1] 582 ms +- 7 ms -> [pypy2_utf82] 529 ms +- 7 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy2_1] 582 ms +- 7 ms -> [pypy2_utf83] 525 ms +- 6 ms: 1.11x faster (-10%)

xml_etree_iterparse
===================

Mean +- std dev: [pypy2_1] 234 ms +- 3 ms -> [pypy2_2] 234 ms +- 5 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy2_1] 234 ms +- 3 ms -> [pypy2_3] 233 ms +- 3 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 234 ms +- 3 ms -> [pypy2_utf81] 209 ms +- 5 ms: 1.12x faster (-11%)
Mean +- std dev: [pypy2_1] 234 ms +- 3 ms -> [pypy2_utf82] 214 ms +- 5 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy2_1] 234 ms +- 3 ms -> [pypy2_utf83] 214 ms +- 5 ms: 1.10x faster (-9%)

xml_etree_generate
==================

Mean +- std dev: [pypy2_1] 82.2 ms +- 0.5 ms -> [pypy2_2] 83.2 ms +- 0.9 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 82.2 ms +- 0.5 ms -> [pypy2_3] 83.6 ms +- 0.8 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 82.2 ms +- 0.5 ms -> [pypy2_utf81] 85.0 ms +- 0.7 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 82.2 ms +- 0.5 ms -> [pypy2_utf82] 84.4 ms +- 0.6 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 82.2 ms +- 0.5 ms -> [pypy2_utf83] 84.8 ms +- 0.7 ms: 1.03x slower (+3%)

xml_etree_process
=================

Mean +- std dev: [pypy2_1] 57.7 ms +- 0.3 ms -> [pypy2_2] 58.1 ms +- 0.8 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 57.7 ms +- 0.3 ms -> [pypy2_3] 58.1 ms +- 0.7 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 57.7 ms +- 0.3 ms -> [pypy2_utf81] 56.8 ms +- 0.9 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 57.7 ms +- 0.3 ms -> [pypy2_utf82] 56.6 ms +- 0.9 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy2_1] 57.7 ms +- 0.3 ms -> [pypy2_utf83] 55.9 ms +- 0.6 ms: 1.03x faster (-3%)
Benchmark hidden because not significant (5): hexiom, logging_silent, pickle_dict, unpack_sequence, unpickle_pure_python
Ignored benchmarks (1) of pypy2_1.json: mako
Ignored benchmarks (1) of pypy2_2.json: mako
Ignored benchmarks (1) of pypy2_3.json: mako