Skip to content

Latest commit

 

History

History
174 lines (147 loc) · 18.6 KB

bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276-vs-3.12.6.md

File metadata and controls

174 lines (147 loc) · 18.6 KB

Results vs. 3.12.6

  • fork: python
  • ref: 828b27680f07f1ed8302
  • machine: linux-x86_64
  • commit hash: 828b276
  • commit date: 2025-01-28
  • overall geometric mean: 1.030x faster
  • HPT reliability: 88.97%
  • HPT 99th percentile: 1.00x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
2to3 456 ms 525 ms: 1.15x slower
html5lib 88.9 ms 99.7 ms: 1.12x slower
Geometric mean (ref) 1.08x slower

Benchmark hidden because not significant (1): docutils

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
async_tree_io_tg 1.93 sec 938 ms: 2.06x faster
async_tree_io 1.85 sec 905 ms: 2.04x faster
async_tree_memoization_tg 930 ms 457 ms: 2.03x faster
async_tree_memoization 977 ms 492 ms: 1.98x faster
async_tree_none 741 ms 422 ms: 1.76x faster
async_tree_none_tg 704 ms 407 ms: 1.73x faster
async_tree_cpu_io_mixed_tg 1.10 sec 690 ms: 1.59x faster
async_tree_cpu_io_mixed 1.08 sec 768 ms: 1.40x faster
async_generators 589 ms 545 ms: 1.08x faster
asyncio_websockets 748 ms 718 ms: 1.04x faster
coroutines 29.5 ms 32.7 ms: 1.11x slower
Geometric mean (ref) 1.54x faster

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
pidigits 250 ms 273 ms: 1.09x slower
nbody 119 ms 139 ms: 1.16x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (1): float

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
regex_effbot 5.13 ms 4.76 ms: 1.08x faster
regex_compile 187 ms 174 ms: 1.07x faster
regex_v8 32.5 ms 39.4 ms: 1.21x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (1): regex_dna

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
tomli_loads 2.88 sec 2.55 sec: 1.13x faster
xml_etree_process 83.7 ms 76.1 ms: 1.10x faster
json_loads 37.9 us 45.1 us: 1.19x slower
json_dumps 14.3 ms 17.6 ms: 1.23x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (5): unpickle_pure_python, xml_etree_iterparse, xml_etree_generate, xml_etree_parse, pickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
python_startup_no_site 17.6 ms 18.9 ms: 1.08x slower
python_startup 23.7 ms 33.2 ms: 1.40x slower
Geometric mean (ref) 1.23x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
genshi_text 30.2 ms 33.0 ms: 1.09x slower
genshi_xml 67.6 ms 74.2 ms: 1.10x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (2): django_template, mako

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276
async_tree_io_tg 1.93 sec 938 ms: 2.06x faster
async_tree_io 1.85 sec 905 ms: 2.04x faster
async_tree_memoization_tg 930 ms 457 ms: 2.03x faster
async_tree_memoization 977 ms 492 ms: 1.98x faster
async_tree_none 741 ms 422 ms: 1.76x faster
async_tree_none_tg 704 ms 407 ms: 1.73x faster
async_tree_cpu_io_mixed_tg 1.10 sec 690 ms: 1.59x faster
async_tree_cpu_io_mixed 1.08 sec 768 ms: 1.40x faster
deepcopy_memo 52.4 us 41.0 us: 1.28x faster
deepcopy 468 us 392 us: 1.19x faster
comprehensions 27.1 us 23.1 us: 1.17x faster
sqlalchemy_declarative 218 ms 187 ms: 1.16x faster
scimark_fft 500 ms 442 ms: 1.13x faster
tomli_loads 2.88 sec 2.55 sec: 1.13x faster
crypto_pyaes 107 ms 95.5 ms: 1.12x faster
bpe_tokeniser 6.59 sec 5.86 sec: 1.12x faster
spectral_norm 156 ms 139 ms: 1.12x faster
xml_etree_process 83.7 ms 76.1 ms: 1.10x faster
async_generators 589 ms 545 ms: 1.08x faster
regex_effbot 5.13 ms 4.76 ms: 1.08x faster
mdp 3.97 sec 3.69 sec: 1.08x faster
regex_compile 187 ms 174 ms: 1.07x faster
pyflate 727 ms 679 ms: 1.07x faster
scimark_sparse_mat_mult 6.70 ms 6.28 ms: 1.07x faster
sqlite_synth 3.87 us 3.69 us: 1.05x faster
asyncio_websockets 748 ms 718 ms: 1.04x faster
thrift 1.06 ms 1.11 ms: 1.05x slower
logging_silent 139 ns 149 ns: 1.07x slower
python_startup_no_site 17.6 ms 18.9 ms: 1.08x slower
sqlglot_optimize 76.0 ms 82.0 ms: 1.08x slower
deltablue 4.27 ms 4.63 ms: 1.09x slower
sympy_sum 222 ms 241 ms: 1.09x slower
pidigits 250 ms 273 ms: 1.09x slower
genshi_text 30.2 ms 33.0 ms: 1.09x slower
deepcopy_reduce 4.04 us 4.41 us: 1.09x slower
json 6.85 ms 7.51 ms: 1.10x slower
genshi_xml 67.6 ms 74.2 ms: 1.10x slower
coroutines 29.5 ms 32.7 ms: 1.11x slower
generators 41.1 ms 46.1 ms: 1.12x slower
html5lib 88.9 ms 99.7 ms: 1.12x slower
sympy_integrate 29.8 ms 33.8 ms: 1.14x slower
meteor_contest 146 ms 168 ms: 1.15x slower
2to3 456 ms 525 ms: 1.15x slower
nbody 119 ms 139 ms: 1.16x slower
hexiom 8.27 ms 9.65 ms: 1.17x slower
logging_format 9.59 us 11.4 us: 1.18x slower
json_loads 37.9 us 45.1 us: 1.19x slower
sqlglot_parse 1.79 ms 2.13 ms: 1.19x slower
regex_v8 32.5 ms 39.4 ms: 1.21x slower
json_dumps 14.3 ms 17.6 ms: 1.23x slower
coverage 95.4 ms 127 ms: 1.33x slower
python_startup 23.7 ms 33.2 ms: 1.40x slower
gc_traversal 5.86 ms 9.45 ms: 1.61x slower
create_gc_cycles 1.94 ms 5.94 ms: 3.06x slower
bench_mp_pool 20.7 ms 108 ms: 5.20x slower
Geometric mean (ref) 1.00x slower

Benchmark hidden because not significant (35): dulwich_log, sympy_str, typing_runtime_protocols, raytrace, sqlglot_transpile, go, pprint_safe_repr, float, pycparser, fannkuch, unpickle_pure_python, pathlib, sqlalchemy_imperative, docutils, sympy_expand, logging_simple, xml_etree_iterparse, bench_thread_pool, nqueens, richards_super, pylint, telco, regex_dna, chaos, pprint_pformat, scimark_sor, scimark_lu, xml_etree_generate, xml_etree_parse, django_template, mako, scimark_monte_carlo, richards, pickle_pure_python, sqlglot_normalize Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (6) of results/bm-20250128-3.14.0a4+-828b276/bm-20250128-linux-x86_64-python-828b27680f07f1ed8302-3.14.0a4+-828b276.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers

  • Geometric mean (including insignificant results): 1.030x faster

HPT report

  • Reliability score: 88.97% likely to be faster
  • 90% likely to have a speedup of 1.00x
  • 95% likely to have a speedup of 1.00x
  • 99% likely to have a speedup of 1.00x

Memory

  • memory change: 1.13x