Skip to content

Latest commit

 

History

History
200 lines (175 loc) · 22.8 KB

bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276-vs-3.12.6.md

File metadata and controls

200 lines (175 loc) · 22.8 KB

Results vs. 3.12.6

  • fork: python
  • ref: 828b27680f07f1ed8302
  • machine: linux-x86_64
  • commit hash: 828b276
  • commit date: 2025-01-28
  • overall geometric mean: 1.095x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.05x slower
  • Memory change: 1.35x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
2to3 456 ms 578 ms: 1.27x slower
docutils 4.00 sec 4.13 sec: 1.03x slower
html5lib 88.9 ms 94.7 ms: 1.07x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
async_tree_io_tg 1.93 sec 789 ms: 2.45x faster
async_tree_io 1.85 sec 915 ms: 2.02x faster
async_tree_none_tg 704 ms 369 ms: 1.91x faster
async_tree_memoization_tg 930 ms 545 ms: 1.71x faster
async_tree_none 741 ms 440 ms: 1.69x faster
async_tree_memoization 977 ms 609 ms: 1.60x faster
async_tree_cpu_io_mixed_tg 1.10 sec 752 ms: 1.46x faster
async_tree_cpu_io_mixed 1.08 sec 838 ms: 1.29x faster
coroutines 29.5 ms 34.1 ms: 1.16x slower
Geometric mean (ref) 1.47x faster

Benchmark hidden because not significant (2): asyncio_websockets, async_generators

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
float 123 ms 113 ms: 1.08x faster
nbody 119 ms 191 ms: 1.60x slower
Geometric mean (ref) 1.14x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
regex_v8 32.5 ms 34.5 ms: 1.06x slower
regex_dna 278 ms 310 ms: 1.12x slower
regex_compile 187 ms 234 ms: 1.25x slower
Geometric mean (ref) 1.09x slower

Benchmark hidden because not significant (1): regex_effbot

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
xml_etree_iterparse 169 ms 156 ms: 1.09x faster
xml_etree_parse 241 ms 223 ms: 1.08x faster
xml_etree_process 83.7 ms 90.7 ms: 1.08x slower
tomli_loads 2.88 sec 3.22 sec: 1.12x slower
xml_etree_generate 127 ms 145 ms: 1.14x slower
json_loads 37.9 us 45.6 us: 1.20x slower
unpickle_pure_python 300 us 381 us: 1.27x slower
json_dumps 14.3 ms 18.4 ms: 1.28x slower
pickle_pure_python 436 us 584 us: 1.34x slower
Geometric mean (ref) 1.13x slower

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
python_startup_no_site 17.6 ms 23.1 ms: 1.31x slower
python_startup 23.7 ms 35.7 ms: 1.51x slower
Geometric mean (ref) 1.41x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
genshi_xml 67.6 ms 86.9 ms: 1.29x slower
genshi_text 30.2 ms 42.6 ms: 1.41x slower
django_template 44.9 ms 64.4 ms: 1.43x slower
mako 15.7 ms 26.3 ms: 1.67x slower
Geometric mean (ref) 1.44x slower

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
async_tree_io_tg 1.93 sec 789 ms: 2.45x faster
async_tree_io 1.85 sec 915 ms: 2.02x faster
async_tree_none_tg 704 ms 369 ms: 1.91x faster
async_tree_memoization_tg 930 ms 545 ms: 1.71x faster
async_tree_none 741 ms 440 ms: 1.69x faster
async_tree_memoization 977 ms 609 ms: 1.60x faster
async_tree_cpu_io_mixed_tg 1.10 sec 752 ms: 1.46x faster
async_tree_cpu_io_mixed 1.08 sec 838 ms: 1.29x faster
deepcopy 468 us 411 us: 1.14x faster
xml_etree_iterparse 169 ms 156 ms: 1.09x faster
float 123 ms 113 ms: 1.08x faster
xml_etree_parse 241 ms 223 ms: 1.08x faster
pycparser 1.79 sec 1.69 sec: 1.06x faster
docutils 4.00 sec 4.13 sec: 1.03x slower
regex_v8 32.5 ms 34.5 ms: 1.06x slower
html5lib 88.9 ms 94.7 ms: 1.07x slower
xml_etree_process 83.7 ms 90.7 ms: 1.08x slower
deepcopy_reduce 4.04 us 4.40 us: 1.09x slower
scimark_fft 500 ms 547 ms: 1.09x slower
pathlib 31.6 ms 34.8 ms: 1.10x slower
bench_thread_pool 3.48 ms 3.83 ms: 1.10x slower
deepcopy_memo 52.4 us 57.7 us: 1.10x slower
sqlglot_transpile 2.34 ms 2.60 ms: 1.11x slower
regex_dna 278 ms 310 ms: 1.12x slower
tomli_loads 2.88 sec 3.22 sec: 1.12x slower
chaos 84.9 ms 95.8 ms: 1.13x slower
xml_etree_generate 127 ms 145 ms: 1.14x slower
pprint_pformat 1.98 sec 2.26 sec: 1.14x slower
pyflate 727 ms 833 ms: 1.15x slower
coroutines 29.5 ms 34.1 ms: 1.16x slower
crypto_pyaes 107 ms 126 ms: 1.18x slower
sqlalchemy_declarative 218 ms 257 ms: 1.18x slower
logging_simple 9.45 us 11.2 us: 1.18x slower
go 172 ms 205 ms: 1.19x slower
pprint_safe_repr 967 ms 1.16 sec: 1.20x slower
json_loads 37.9 us 45.6 us: 1.20x slower
sqlglot_optimize 76.0 ms 91.8 ms: 1.21x slower
bpe_tokeniser 6.59 sec 8.01 sec: 1.22x slower
logging_silent 139 ns 170 ns: 1.22x slower
scimark_sor 167 ms 205 ms: 1.23x slower
generators 41.1 ms 50.7 ms: 1.23x slower
meteor_contest 146 ms 181 ms: 1.24x slower
scimark_sparse_mat_mult 6.70 ms 8.32 ms: 1.24x slower
hexiom 8.27 ms 10.3 ms: 1.24x slower
thrift 1.06 ms 1.32 ms: 1.24x slower
fannkuch 540 ms 673 ms: 1.24x slower
raytrace 408 ms 509 ms: 1.25x slower
regex_compile 187 ms 234 ms: 1.25x slower
nqueens 117 ms 148 ms: 1.26x slower
sqlalchemy_imperative 24.7 ms 31.3 ms: 1.27x slower
2to3 456 ms 578 ms: 1.27x slower
richards_super 72.8 ms 92.3 ms: 1.27x slower
unpickle_pure_python 300 us 381 us: 1.27x slower
sympy_expand 582 ms 741 ms: 1.27x slower
sympy_integrate 29.8 ms 38.0 ms: 1.28x slower
json 6.85 ms 8.76 ms: 1.28x slower
scimark_lu 152 ms 195 ms: 1.28x slower
sympy_str 385 ms 493 ms: 1.28x slower
json_dumps 14.3 ms 18.4 ms: 1.28x slower
genshi_xml 67.6 ms 86.9 ms: 1.29x slower
sympy_sum 222 ms 289 ms: 1.30x slower
scimark_monte_carlo 96.4 ms 126 ms: 1.31x slower
typing_runtime_protocols 224 us 294 us: 1.31x slower
python_startup_no_site 17.6 ms 23.1 ms: 1.31x slower
pickle_pure_python 436 us 584 us: 1.34x slower
richards 60.3 ms 81.8 ms: 1.36x slower
logging_format 9.59 us 13.3 us: 1.38x slower
genshi_text 30.2 ms 42.6 ms: 1.41x slower
coverage 95.4 ms 136 ms: 1.43x slower
sqlglot_parse 1.79 ms 2.56 ms: 1.43x slower
django_template 44.9 ms 64.4 ms: 1.43x slower
telco 9.59 ms 13.9 ms: 1.45x slower
gc_traversal 5.86 ms 8.72 ms: 1.49x slower
python_startup 23.7 ms 35.7 ms: 1.51x slower
create_gc_cycles 1.94 ms 2.99 ms: 1.54x slower
nbody 119 ms 191 ms: 1.60x slower
mako 15.7 ms 26.3 ms: 1.67x slower
deltablue 4.27 ms 7.51 ms: 1.76x slower
bench_mp_pool 20.7 ms 93.2 ms: 4.51x slower
Geometric mean (ref) 1.14x slower

Benchmark hidden because not significant (11): regex_effbot, asyncio_websockets, async_generators, sqlite_synth, pidigits, pylint, sqlglot_normalize, comprehensions, mdp, spectral_norm, dulwich_log Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250128-3.14.0a4+-828b276-NOGIL/bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.095x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.09x
  • 95% likely to have a slowdown of 1.08x
  • 99% likely to have a slowdown of 1.05x

Memory

  • memory change: 1.35x