fork: mdboom
ref: no_inline
machine: windows-amd64
commit hash: ddcf45a
commit date: 2024-08-21
overall geometric mean: 1.04x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.03x slower
Memory change: unknown
fork: mdboom
ref: no_inline
machine: windows-amd64
commit hash: ddcf45a
commit date: 2024-08-21
overall geometric mean: 1.04x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.03x slower
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
2to3
209 ms
222 ms: 1.06x slower
docutils
1.61 sec
1.68 sec: 1.04x slower
html5lib
34.8 ms
35.6 ms: 1.02x slower
tornado_http
80.3 ms
91.3 ms: 1.14x slower
Geometric mean
(ref)
1.07x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
async_tree_io_tg
509 ms
523 ms: 1.03x slower
async_tree_memoization_tg
235 ms
245 ms: 1.04x slower
async_tree_cpu_io_mixed_tg
372 ms
391 ms: 1.05x slower
async_tree_io
507 ms
535 ms: 1.06x slower
async_tree_memoization
241 ms
256 ms: 1.06x slower
async_tree_none
196 ms
209 ms: 1.06x slower
async_tree_none_tg
179 ms
190 ms: 1.06x slower
Geometric mean
(ref)
1.05x slower
Benchmark hidden because not significant (1): async_tree_cpu_io_mixed
Benchmarks with tag 'math':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
nbody
66.8 ms
67.4 ms: 1.01x slower
pidigits
151 ms
154 ms: 1.02x slower
float
49.5 ms
52.2 ms: 1.05x slower
Geometric mean
(ref)
1.03x slower
Benchmarks with tag 'regex':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
regex_dna
120 ms
121 ms: 1.01x slower
regex_compile
76.1 ms
79.4 ms: 1.04x slower
Geometric mean
(ref)
1.00x faster
Benchmark hidden because not significant (2): regex_v8, regex_effbot
Benchmarks with tag 'serialize':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
tomli_loads
1.37 sec
1.41 sec: 1.03x slower
json_loads
13.8 us
14.2 us: 1.03x slower
xml_etree_generate
53.5 ms
55.6 ms: 1.04x slower
xml_etree_process
36.4 ms
37.9 ms: 1.04x slower
json_dumps
5.65 ms
5.89 ms: 1.04x slower
pickle_pure_python
177 us
185 us: 1.05x slower
unpickle_pure_python
123 us
131 us: 1.06x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (2): xml_etree_parse, xml_etree_iterparse
Benchmarks with tag 'startup':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
python_startup_no_site
17.4 ms
18.1 ms: 1.04x slower
python_startup
20.6 ms
22.1 ms: 1.07x slower
Geometric mean
(ref)
1.06x slower
Benchmarks with tag 'template':
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
mako
6.59 ms
6.72 ms: 1.02x slower
django_template
21.8 ms
22.4 ms: 1.03x slower
genshi_text
14.8 ms
15.4 ms: 1.04x slower
Geometric mean
(ref)
1.03x slower
Benchmark hidden because not significant (1): genshi_xml
Benchmark
bm-20240626-pythonperf1-amd64-python-d611c4c8e9893c081696-3.14.0a0-d611c4c
bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a
scimark_sparse_mat_mult
2.63 ms
2.55 ms: 1.03x faster
coroutines
13.3 ms
13.2 ms: 1.01x faster
deltablue
1.93 ms
1.92 ms: 1.01x faster
hexiom
3.70 ms
3.72 ms: 1.01x slower
nbody
66.8 ms
67.4 ms: 1.01x slower
sqlglot_parse
768 us
777 us: 1.01x slower
raytrace
157 ms
159 ms: 1.01x slower
regex_dna
120 ms
121 ms: 1.01x slower
sympy_str
160 ms
162 ms: 1.01x slower
go
83.5 ms
84.8 ms: 1.02x slower
pprint_safe_repr
481 ms
489 ms: 1.02x slower
mako
6.59 ms
6.72 ms: 1.02x slower
html5lib
34.8 ms
35.6 ms: 1.02x slower
pidigits
151 ms
154 ms: 1.02x slower
deepcopy
164 us
167 us: 1.02x slower
richards_super
29.5 ms
30.2 ms: 1.02x slower
richards
26.0 ms
26.7 ms: 1.03x slower
json
2.89 ms
2.96 ms: 1.03x slower
logging_silent
53.8 ns
55.2 ns: 1.03x slower
sympy_sum
84.2 ms
86.4 ms: 1.03x slower
django_template
21.8 ms
22.4 ms: 1.03x slower
tomli_loads
1.37 sec
1.41 sec: 1.03x slower
sqlglot_optimize
32.6 ms
33.5 ms: 1.03x slower
async_tree_io_tg
509 ms
523 ms: 1.03x slower
chaos
38.0 ms
39.1 ms: 1.03x slower
json_loads
13.8 us
14.2 us: 1.03x slower
deepcopy_reduce
1.68 us
1.73 us: 1.03x slower
logging_format
6.09 us
6.27 us: 1.03x slower
crypto_pyaes
44.9 ms
46.2 ms: 1.03x slower
nqueens
56.9 ms
58.6 ms: 1.03x slower
sqlglot_normalize
174 ms
179 ms: 1.03x slower
create_gc_cycles
889 us
918 us: 1.03x slower
pprint_pformat
982 ms
1.01 sec: 1.03x slower
coverage
45.7 ms
47.3 ms: 1.03x slower
gc_traversal
1.55 ms
1.60 ms: 1.04x slower
comprehensions
10.3 us
10.6 us: 1.04x slower
sympy_integrate
12.2 ms
12.7 ms: 1.04x slower
xml_etree_generate
53.5 ms
55.6 ms: 1.04x slower
xml_etree_process
36.4 ms
37.9 ms: 1.04x slower
sqlglot_transpile
962 us
999 us: 1.04x slower
meteor_contest
70.8 ms
73.7 ms: 1.04x slower
deepcopy_memo
17.1 us
17.8 us: 1.04x slower
sympy_expand
275 ms
286 ms: 1.04x slower
python_startup_no_site
17.4 ms
18.1 ms: 1.04x slower
async_tree_memoization_tg
235 ms
245 ms: 1.04x slower
spectral_norm
61.4 ms
64.0 ms: 1.04x slower
genshi_text
14.8 ms
15.4 ms: 1.04x slower
json_dumps
5.65 ms
5.89 ms: 1.04x slower
regex_compile
76.1 ms
79.4 ms: 1.04x slower
telco
4.64 ms
4.85 ms: 1.04x slower
docutils
1.61 sec
1.68 sec: 1.04x slower
fannkuch
243 ms
255 ms: 1.05x slower
pickle_pure_python
177 us
185 us: 1.05x slower
bench_mp_pool
64.9 ms
68.1 ms: 1.05x slower
scimark_lu
55.3 ms
58.0 ms: 1.05x slower
async_tree_cpu_io_mixed_tg
372 ms
391 ms: 1.05x slower
pyflate
279 ms
293 ms: 1.05x slower
float
49.5 ms
52.2 ms: 1.05x slower
async_tree_io
507 ms
535 ms: 1.06x slower
generators
20.3 ms
21.5 ms: 1.06x slower
async_generators
227 ms
241 ms: 1.06x slower
mdp
1.35 sec
1.43 sec: 1.06x slower
unpickle_pure_python
123 us
131 us: 1.06x slower
2to3
209 ms
222 ms: 1.06x slower
async_tree_memoization
241 ms
256 ms: 1.06x slower
async_tree_none
196 ms
209 ms: 1.06x slower
async_tree_none_tg
179 ms
190 ms: 1.06x slower
typing_runtime_protocols
100 us
107 us: 1.07x slower
scimark_fft
174 ms
186 ms: 1.07x slower
scimark_monte_carlo
39.6 ms
42.4 ms: 1.07x slower
python_startup
20.6 ms
22.1 ms: 1.07x slower
bench_thread_pool
746 us
799 us: 1.07x slower
pathlib
75.2 ms
81.2 ms: 1.08x slower
scimark_sor
73.5 ms
81.9 ms: 1.11x slower
tornado_http
80.3 ms
91.3 ms: 1.14x slower
asyncio_tcp
482 ms
550 ms: 1.14x slower
asyncio_tcp_ssl
1.49 sec
1.74 sec: 1.17x slower
Geometric mean
(ref)
1.04x slower
Benchmark hidden because not significant (10): regex_v8, regex_effbot, xml_etree_parse, xml_etree_iterparse, thrift, logging_simple, async_tree_cpu_io_mixed, pycparser, genshi_xml, pylint
Ignored benchmarks (1) of results/bm-20240821-3.14.0a0-ddcf45a/bm-20240821-pythonperf1-amd64-mdboom-no_inline-3.14.0a0-ddcf45a.json: dulwich_log
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.03x
95% likely to have a slowdown of 1.03x
99% likely to have a slowdown of 1.03x
