fork: python
ref: d89a5f6a6e65511a5f6e
machine: linux-x86_64
commit hash: d89a5f6
commit date: 2025-01-31
overall geometric mean: 1.035x faster
HPT reliability: 99.71%
HPT 99th percentile: 1.00x faster
Memory change: 1.13x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
2to3
445 ms
478 ms: 1.07x slower
docutils
4.01 sec
3.66 sec: 1.10x faster
html5lib
92.6 ms
79.3 ms: 1.17x faster
Geometric mean
(ref)
1.06x faster
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
async_tree_io_tg
1.40 sec
891 ms: 1.57x faster
async_tree_io
1.39 sec
951 ms: 1.46x faster
async_tree_memoization
709 ms
487 ms: 1.46x faster
async_tree_memoization_tg
670 ms
466 ms: 1.44x faster
async_tree_none
572 ms
435 ms: 1.31x faster
async_tree_none_tg
504 ms
400 ms: 1.26x faster
async_tree_cpu_io_mixed
889 ms
716 ms: 1.24x faster
async_generators
567 ms
498 ms: 1.14x faster
async_tree_cpu_io_mixed_tg
852 ms
749 ms: 1.14x faster
Geometric mean
(ref)
1.25x faster
Benchmark hidden because not significant (2): asyncio_websockets, coroutines
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
nbody
119 ms
129 ms: 1.08x slower
Geometric mean
(ref)
1.00x faster
Benchmark hidden because not significant (2): float, pidigits
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
regex_effbot
4.74 ms
4.47 ms: 1.06x faster
regex_v8
32.8 ms
36.3 ms: 1.11x slower
Geometric mean
(ref)
1.02x slower
Benchmark hidden because not significant (2): regex_dna, regex_compile
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
xml_etree_parse
231 ms
187 ms: 1.23x faster
tomli_loads
2.78 sec
2.49 sec: 1.12x faster
xml_etree_iterparse
177 ms
161 ms: 1.10x faster
xml_etree_process
85.9 ms
79.4 ms: 1.08x faster
xml_etree_generate
122 ms
117 ms: 1.05x faster
unpickle_pure_python
290 us
302 us: 1.04x slower
json_dumps
14.1 ms
15.2 ms: 1.07x slower
json_loads
34.3 us
38.6 us: 1.13x slower
Geometric mean
(ref)
1.04x faster
Benchmark hidden because not significant (1): pickle_pure_python
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
python_startup_no_site
15.3 ms
16.1 ms: 1.05x slower
python_startup
22.4 ms
27.9 ms: 1.25x slower
Geometric mean
(ref)
1.14x slower
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
genshi_xml
72.1 ms
66.3 ms: 1.09x faster
genshi_text
31.7 ms
29.6 ms: 1.07x faster
mako
15.9 ms
17.9 ms: 1.12x slower
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (1): django_template
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
async_tree_io_tg
1.40 sec
891 ms: 1.57x faster
async_tree_io
1.39 sec
951 ms: 1.46x faster
async_tree_memoization
709 ms
487 ms: 1.46x faster
async_tree_memoization_tg
670 ms
466 ms: 1.44x faster
deepcopy
498 us
354 us: 1.40x faster
async_tree_none
572 ms
435 ms: 1.31x faster
deepcopy_memo
50.1 us
39.7 us: 1.26x faster
async_tree_none_tg
504 ms
400 ms: 1.26x faster
async_tree_cpu_io_mixed
889 ms
716 ms: 1.24x faster
xml_etree_parse
231 ms
187 ms: 1.23x faster
telco
12.2 ms
9.94 ms: 1.22x faster
go
191 ms
159 ms: 1.20x faster
html5lib
92.6 ms
79.3 ms: 1.17x faster
deepcopy_reduce
4.10 us
3.60 us: 1.14x faster
async_generators
567 ms
498 ms: 1.14x faster
async_tree_cpu_io_mixed_tg
852 ms
749 ms: 1.14x faster
pylint
470 ms
418 ms: 1.12x faster
scimark_sor
179 ms
159 ms: 1.12x faster
tomli_loads
2.78 sec
2.49 sec: 1.12x faster
richards
65.5 ms
59.2 ms: 1.11x faster
bpe_tokeniser
6.28 sec
5.69 sec: 1.10x faster
spectral_norm
157 ms
142 ms: 1.10x faster
xml_etree_iterparse
177 ms
161 ms: 1.10x faster
docutils
4.01 sec
3.66 sec: 1.10x faster
genshi_xml
72.1 ms
66.3 ms: 1.09x faster
xml_etree_process
85.9 ms
79.4 ms: 1.08x faster
genshi_text
31.7 ms
29.6 ms: 1.07x faster
sympy_integrate
30.2 ms
28.4 ms: 1.07x faster
regex_effbot
4.74 ms
4.47 ms: 1.06x faster
sqlite_synth
3.99 us
3.77 us: 1.06x faster
mdp
3.80 sec
3.60 sec: 1.05x faster
sympy_sum
210 ms
200 ms: 1.05x faster
xml_etree_generate
122 ms
117 ms: 1.05x faster
unpickle_pure_python
290 us
302 us: 1.04x slower
python_startup_no_site
15.3 ms
16.1 ms: 1.05x slower
json_dumps
14.1 ms
15.2 ms: 1.07x slower
2to3
445 ms
478 ms: 1.07x slower
nbody
119 ms
129 ms: 1.08x slower
typing_runtime_protocols
226 us
246 us: 1.09x slower
scimark_lu
146 ms
160 ms: 1.10x slower
meteor_contest
150 ms
165 ms: 1.10x slower
richards_super
73.2 ms
80.7 ms: 1.10x slower
regex_v8
32.8 ms
36.3 ms: 1.11x slower
sympy_expand
601 ms
669 ms: 1.11x slower
logging_format
9.24 us
10.3 us: 1.12x slower
mako
15.9 ms
17.9 ms: 1.12x slower
json_loads
34.3 us
38.6 us: 1.13x slower
logging_silent
130 ns
148 ns: 1.14x slower
sqlglot_parse
1.76 ms
2.00 ms: 1.14x slower
coverage
107 ms
124 ms: 1.16x slower
hexiom
8.11 ms
9.72 ms: 1.20x slower
python_startup
22.4 ms
27.9 ms: 1.25x slower
gc_traversal
5.70 ms
9.12 ms: 1.60x slower
create_gc_cycles
2.41 ms
3.98 ms: 1.65x slower
bench_mp_pool
18.7 ms
95.8 ms: 5.12x slower
Geometric mean
(ref)
1.01x faster
Benchmark hidden because not significant (33): deltablue, float, pidigits, pickle_pure_python, pathlib, nqueens, scimark_fft, pyflate, sqlglot_transpile, pprint_pformat, scimark_sparse_mat_mult, sympy_str, asyncio_websockets, json, thrift, django_template, scimark_monte_carlo, chaos, pycparser, fannkuch, regex_dna, regex_compile, generators, dulwich_log, logging_simple, crypto_pyaes, pprint_safe_repr, comprehensions, sqlglot_normalize, sqlglot_optimize, raytrace, bench_thread_pool, coroutines
Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (8) of results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
Geometric mean (including insignificant results): 1.035x faster
Reliability score: 99.71% likely to be faster
90% likely to have a speedup of 1.02x
95% likely to have a speedup of 1.01x
99% likely to have a speedup of 1.00x