Skip to content

Latest commit

 

History

History
196 lines (171 loc) · 22.2 KB

bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6-vs-3.12.6.md

File metadata and controls

196 lines (171 loc) · 22.2 KB

Results vs. 3.12.6

  • fork: python
  • ref: d89a5f6a6e65511a5f6e
  • machine: linux-x86_64
  • commit hash: d89a5f6
  • commit date: 2025-01-31
  • overall geometric mean: 1.035x slower
  • HPT reliability: 99.66%
  • HPT 99th percentile: 1.00x slower
  • Memory change: 1.35x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
2to3 456 ms 552 ms: 1.21x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (2): docutils, html5lib

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
async_tree_io_tg 1.93 sec 762 ms: 2.54x faster
async_tree_io 1.85 sec 884 ms: 2.09x faster
async_tree_memoization_tg 930 ms 481 ms: 1.94x faster
async_tree_memoization 977 ms 517 ms: 1.89x faster
async_tree_none_tg 704 ms 392 ms: 1.80x faster
async_tree_none 741 ms 437 ms: 1.70x faster
async_tree_cpu_io_mixed_tg 1.10 sec 698 ms: 1.58x faster
async_tree_cpu_io_mixed 1.08 sec 819 ms: 1.32x faster
coroutines 29.5 ms 31.0 ms: 1.05x slower
asyncio_websockets 748 ms 790 ms: 1.06x slower
Geometric mean (ref) 1.53x faster

Benchmark hidden because not significant (1): async_generators

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
float 123 ms 103 ms: 1.19x faster
pidigits 250 ms 226 ms: 1.11x faster
nbody 119 ms 186 ms: 1.56x slower
Geometric mean (ref) 1.06x slower

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
regex_effbot 5.13 ms 4.23 ms: 1.21x faster
regex_compile 187 ms 203 ms: 1.09x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (2): regex_v8, regex_dna

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
xml_etree_iterparse 169 ms 144 ms: 1.17x faster
xml_etree_parse 241 ms 219 ms: 1.10x faster
unpickle_pure_python 300 us 311 us: 1.04x slower
tomli_loads 2.88 sec 3.12 sec: 1.08x slower
xml_etree_generate 127 ms 144 ms: 1.13x slower
xml_etree_process 83.7 ms 95.7 ms: 1.14x slower
pickle_pure_python 436 us 502 us: 1.15x slower
json_loads 37.9 us 45.4 us: 1.20x slower
json_dumps 14.3 ms 19.7 ms: 1.38x slower
Geometric mean (ref) 1.09x slower

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
python_startup_no_site 17.6 ms 20.2 ms: 1.15x slower
python_startup 23.7 ms 35.3 ms: 1.49x slower
Geometric mean (ref) 1.31x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
django_template 44.9 ms 54.4 ms: 1.21x slower
genshi_text 30.2 ms 38.3 ms: 1.27x slower
genshi_xml 67.6 ms 91.2 ms: 1.35x slower
mako 15.7 ms 24.8 ms: 1.57x slower
Geometric mean (ref) 1.34x slower

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6
async_tree_io_tg 1.93 sec 762 ms: 2.54x faster
async_tree_io 1.85 sec 884 ms: 2.09x faster
async_tree_memoization_tg 930 ms 481 ms: 1.94x faster
async_tree_memoization 977 ms 517 ms: 1.89x faster
async_tree_none_tg 704 ms 392 ms: 1.80x faster
async_tree_none 741 ms 437 ms: 1.70x faster
async_tree_cpu_io_mixed_tg 1.10 sec 698 ms: 1.58x faster
gc_traversal 5.86 ms 4.32 ms: 1.36x faster
async_tree_cpu_io_mixed 1.08 sec 819 ms: 1.32x faster
regex_effbot 5.13 ms 4.23 ms: 1.21x faster
float 123 ms 103 ms: 1.19x faster
xml_etree_iterparse 169 ms 144 ms: 1.17x faster
pycparser 1.79 sec 1.56 sec: 1.15x faster
pidigits 250 ms 226 ms: 1.11x faster
xml_etree_parse 241 ms 219 ms: 1.10x faster
deepcopy 468 us 428 us: 1.09x faster
sqlite_synth 3.87 us 3.54 us: 1.09x faster
pyflate 727 ms 699 ms: 1.04x faster
generators 41.1 ms 42.7 ms: 1.04x slower
unpickle_pure_python 300 us 311 us: 1.04x slower
coroutines 29.5 ms 31.0 ms: 1.05x slower
richards_super 72.8 ms 76.4 ms: 1.05x slower
asyncio_websockets 748 ms 790 ms: 1.06x slower
logging_format 9.59 us 10.2 us: 1.06x slower
sympy_str 385 ms 410 ms: 1.06x slower
sqlglot_transpile 2.34 ms 2.49 ms: 1.07x slower
go 172 ms 186 ms: 1.08x slower
comprehensions 27.1 us 29.3 us: 1.08x slower
tomli_loads 2.88 sec 3.12 sec: 1.08x slower
sympy_sum 222 ms 240 ms: 1.08x slower
regex_compile 187 ms 203 ms: 1.09x slower
scimark_monte_carlo 96.4 ms 106 ms: 1.10x slower
scimark_fft 500 ms 554 ms: 1.11x slower
raytrace 408 ms 452 ms: 1.11x slower
bpe_tokeniser 6.59 sec 7.32 sec: 1.11x slower
logging_simple 9.45 us 10.6 us: 1.12x slower
deepcopy_reduce 4.04 us 4.53 us: 1.12x slower
pprint_pformat 1.98 sec 2.23 sec: 1.13x slower
xml_etree_generate 127 ms 144 ms: 1.13x slower
scimark_sparse_mat_mult 6.70 ms 7.63 ms: 1.14x slower
logging_silent 139 ns 159 ns: 1.14x slower
xml_etree_process 83.7 ms 95.7 ms: 1.14x slower
python_startup_no_site 17.6 ms 20.2 ms: 1.15x slower
dulwich_log 100 ms 115 ms: 1.15x slower
pickle_pure_python 436 us 502 us: 1.15x slower
nqueens 117 ms 136 ms: 1.17x slower
thrift 1.06 ms 1.25 ms: 1.18x slower
chaos 84.9 ms 101 ms: 1.19x slower
meteor_contest 146 ms 174 ms: 1.19x slower
crypto_pyaes 107 ms 128 ms: 1.20x slower
pprint_safe_repr 967 ms 1.16 sec: 1.20x slower
json_loads 37.9 us 45.4 us: 1.20x slower
2to3 456 ms 552 ms: 1.21x slower
django_template 44.9 ms 54.4 ms: 1.21x slower
sympy_integrate 29.8 ms 36.4 ms: 1.22x slower
sqlalchemy_imperative 24.7 ms 30.2 ms: 1.22x slower
sympy_expand 582 ms 714 ms: 1.23x slower
bench_thread_pool 3.48 ms 4.28 ms: 1.23x slower
richards 60.3 ms 75.0 ms: 1.24x slower
fannkuch 540 ms 675 ms: 1.25x slower
telco 9.59 ms 12.0 ms: 1.25x slower
genshi_text 30.2 ms 38.3 ms: 1.27x slower
scimark_lu 152 ms 193 ms: 1.27x slower
hexiom 8.27 ms 10.9 ms: 1.32x slower
sqlglot_optimize 76.0 ms 101 ms: 1.33x slower
typing_runtime_protocols 224 us 299 us: 1.33x slower
sqlglot_parse 1.79 ms 2.41 ms: 1.35x slower
genshi_xml 67.6 ms 91.2 ms: 1.35x slower
json_dumps 14.3 ms 19.7 ms: 1.38x slower
python_startup 23.7 ms 35.3 ms: 1.49x slower
create_gc_cycles 1.94 ms 2.97 ms: 1.53x slower
coverage 95.4 ms 148 ms: 1.55x slower
deltablue 4.27 ms 6.62 ms: 1.55x slower
nbody 119 ms 186 ms: 1.56x slower
mako 15.7 ms 24.8 ms: 1.57x slower
bench_mp_pool 20.7 ms 89.8 ms: 4.34x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (14): regex_v8, spectral_norm, html5lib, mdp, docutils, async_generators, scimark_sor, json, pylint, deepcopy_memo, regex_dna, sqlalchemy_declarative, pathlib, sqlglot_normalize Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.035x slower

HPT report

  • Reliability score: 99.66% likely to be slow
  • 90% likely to have a slowdown of 1.03x
  • 95% likely to have a slowdown of 1.02x
  • 99% likely to have a slowdown of 1.00x

Memory

  • memory change: 1.35x