Skip to content

Latest commit

 

History

History
205 lines (180 loc) · 38.3 KB

bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6-vs-base.md

File metadata and controls

205 lines (180 loc) · 38.3 KB

Results vs. base

  • fork: python
  • ref: d89a5f6a6e65511a5f6e
  • machine: linux-x86_64
  • commit hash: d89a5f6
  • commit date: 2025-01-31
  • overall geometric mean: 1.100x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.08x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
2to3 478 ms 552 ms: 1.15x slower
docutils 3.66 sec 3.98 sec: 1.09x slower
html5lib 79.3 ms 87.9 ms: 1.11x slower
sphinx 1.39 sec 1.58 sec: 1.14x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
async_tree_io_tg 891 ms 762 ms: 1.17x faster
async_tree_io 951 ms 884 ms: 1.08x faster
async_tree_cpu_io_mixed_tg 749 ms 698 ms: 1.07x faster
coroutines 32.5 ms 31.0 ms: 1.05x faster
async_tree_memoization 487 ms 517 ms: 1.06x slower
async_tree_cpu_io_mixed 716 ms 819 ms: 1.14x slower
async_generators 498 ms 590 ms: 1.18x slower
Geometric mean (ref) 1.01x slower

Benchmark hidden because not significant (4): async_tree_none_tg, async_tree_none, asyncio_websockets, async_tree_memoization_tg

Benchmarks with tag 'math':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
float 111 ms 103 ms: 1.08x faster
pidigits 242 ms 226 ms: 1.07x faster
nbody 129 ms 186 ms: 1.45x slower
Geometric mean (ref) 1.08x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
regex_v8 36.3 ms 31.7 ms: 1.14x faster
regex_effbot 4.47 ms 4.23 ms: 1.06x faster
regex_compile 185 ms 203 ms: 1.10x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (1): regex_dna

Benchmarks with tag 'serialize':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
xml_etree_iterparse 161 ms 144 ms: 1.11x faster
xml_etree_parse 187 ms 219 ms: 1.17x slower
json_loads 38.6 us 45.4 us: 1.18x slower
xml_etree_process 79.4 ms 95.7 ms: 1.21x slower
xml_etree_generate 117 ms 144 ms: 1.24x slower
pickle_pure_python 402 us 502 us: 1.25x slower
tomli_loads 2.49 sec 3.12 sec: 1.26x slower
json_dumps 15.2 ms 19.7 ms: 1.30x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (1): unpickle_pure_python

Benchmarks with tag 'startup':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
python_startup_no_site 16.1 ms 20.2 ms: 1.26x slower
python_startup 27.9 ms 35.3 ms: 1.27x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
django_template 44.7 ms 54.4 ms: 1.22x slower
genshi_text 29.6 ms 38.3 ms: 1.29x slower
genshi_xml 66.3 ms 91.2 ms: 1.38x slower
mako 17.9 ms 24.8 ms: 1.38x slower
Geometric mean (ref) 1.32x slower

All benchmarks:

Benchmark results/bm-20250131-3.14.0a4+-d89a5f6/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json results/bm-20250131-3.14.0a4+-d89a5f6-NOGIL/bm-20250131-linux-x86_64-python-d89a5f6a6e65511a5f6e-3.14.0a4+-d89a5f6.json
gc_traversal 9.12 ms 4.32 ms: 2.11x faster
create_gc_cycles 3.98 ms 2.97 ms: 1.34x faster
async_tree_io_tg 891 ms 762 ms: 1.17x faster
regex_v8 36.3 ms 31.7 ms: 1.14x faster
xml_etree_iterparse 161 ms 144 ms: 1.11x faster
float 111 ms 103 ms: 1.08x faster
async_tree_io 951 ms 884 ms: 1.08x faster
async_tree_cpu_io_mixed_tg 749 ms 698 ms: 1.07x faster
pidigits 242 ms 226 ms: 1.07x faster
bench_mp_pool 95.8 ms 89.8 ms: 1.07x faster
sqlite_synth 3.77 us 3.54 us: 1.07x faster
regex_effbot 4.47 ms 4.23 ms: 1.06x faster
richards_super 80.7 ms 76.4 ms: 1.06x faster
coroutines 32.5 ms 31.0 ms: 1.05x faster
generators 40.8 ms 42.7 ms: 1.05x slower
scimark_sor 159 ms 167 ms: 1.05x slower
meteor_contest 165 ms 174 ms: 1.06x slower
async_tree_memoization 487 ms 517 ms: 1.06x slower
json 6.53 ms 6.94 ms: 1.06x slower
sympy_expand 669 ms 714 ms: 1.07x slower
pyflate 650 ms 699 ms: 1.07x slower
logging_silent 148 ns 159 ns: 1.07x slower
shortest_path 917 ms 987 ms: 1.08x slower
spectral_norm 142 ms 154 ms: 1.08x slower
sympy_str 379 ms 410 ms: 1.08x slower
docutils 3.66 sec 3.98 sec: 1.09x slower
mdp 3.60 sec 3.94 sec: 1.09x slower
regex_compile 185 ms 203 ms: 1.10x slower
html5lib 79.3 ms 87.9 ms: 1.11x slower
pathlib 29.2 ms 32.6 ms: 1.12x slower
hexiom 9.72 ms 10.9 ms: 1.12x slower
thrift 1.11 ms 1.25 ms: 1.13x slower
scimark_sparse_mat_mult 6.75 ms 7.63 ms: 1.13x slower
pylint 418 ms 475 ms: 1.13x slower
sphinx 1.39 sec 1.58 sec: 1.14x slower
sqlglot_normalize 144 ms 164 ms: 1.14x slower
connected_components 818 ms 930 ms: 1.14x slower
pprint_safe_repr 1.01 sec 1.16 sec: 1.14x slower
async_tree_cpu_io_mixed 716 ms 819 ms: 1.14x slower
many_optionals 1.18 ms 1.36 ms: 1.15x slower
2to3 478 ms 552 ms: 1.15x slower
sqlglot_transpile 2.16 ms 2.49 ms: 1.15x slower
scimark_monte_carlo 91.5 ms 106 ms: 1.16x slower
pprint_pformat 1.92 sec 2.23 sec: 1.16x slower
go 159 ms 186 ms: 1.17x slower
xml_etree_parse 187 ms 219 ms: 1.17x slower
json_loads 38.6 us 45.4 us: 1.18x slower
async_generators 498 ms 590 ms: 1.18x slower
coverage 124 ms 148 ms: 1.19x slower
chaos 84.5 ms 101 ms: 1.19x slower
scimark_fft 464 ms 554 ms: 1.19x slower
dulwich_log 95.9 ms 115 ms: 1.20x slower
scimark_lu 160 ms 193 ms: 1.20x slower
sqlalchemy_declarative 186 ms 224 ms: 1.20x slower
sympy_sum 200 ms 240 ms: 1.20x slower
xml_etree_process 79.4 ms 95.7 ms: 1.21x slower
deepcopy 354 us 428 us: 1.21x slower
sqlglot_parse 2.00 ms 2.41 ms: 1.21x slower
logging_simple 8.77 us 10.6 us: 1.21x slower
telco 9.94 ms 12.0 ms: 1.21x slower
typing_runtime_protocols 246 us 299 us: 1.22x slower
django_template 44.7 ms 54.4 ms: 1.22x slower
fannkuch 554 ms 675 ms: 1.22x slower
xml_etree_generate 117 ms 144 ms: 1.24x slower
crypto_pyaes 103 ms 128 ms: 1.25x slower
pickle_pure_python 402 us 502 us: 1.25x slower
nqueens 109 ms 136 ms: 1.25x slower
tomli_loads 2.49 sec 3.12 sec: 1.26x slower
python_startup_no_site 16.1 ms 20.2 ms: 1.26x slower
deepcopy_reduce 3.60 us 4.53 us: 1.26x slower
sqlalchemy_imperative 23.9 ms 30.2 ms: 1.27x slower
richards 59.2 ms 75.0 ms: 1.27x slower
python_startup 27.9 ms 35.3 ms: 1.27x slower
raytrace 356 ms 452 ms: 1.27x slower
sympy_integrate 28.4 ms 36.4 ms: 1.28x slower
comprehensions 22.8 us 29.3 us: 1.28x slower
bpe_tokeniser 5.69 sec 7.32 sec: 1.29x slower
genshi_text 29.6 ms 38.3 ms: 1.29x slower
json_dumps 15.2 ms 19.7 ms: 1.30x slower
sqlglot_optimize 77.1 ms 101 ms: 1.31x slower
subparsers 31.9 ms 42.4 ms: 1.33x slower
deepcopy_memo 39.7 us 53.7 us: 1.35x slower
genshi_xml 66.3 ms 91.2 ms: 1.38x slower
mako 17.9 ms 24.8 ms: 1.38x slower
bench_thread_pool 3.00 ms 4.28 ms: 1.43x slower
nbody 129 ms 186 ms: 1.45x slower
deltablue 4.25 ms 6.62 ms: 1.56x slower
Geometric mean (ref) 1.12x slower

Benchmark hidden because not significant (9): pycparser, async_tree_none_tg, logging_format, regex_dna, async_tree_none, k_core, asyncio_websockets, unpickle_pure_python, async_tree_memoization_tg

  • Geometric mean (including insignificant results): 1.100x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.11x
  • 95% likely to have a slowdown of 1.10x
  • 99% likely to have a slowdown of 1.08x

Memory

  • memory change: 1.19x