Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update Gradle dependencies #8284

Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Update Gradle dependencies #8284

wants to merge 5 commits into from

Conversation

github-actions[bot]
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Jan 26, 2025
@github-actions github-actions bot requested review from a team as code owners January 26, 2025 04:18
@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
release_version 1.46.0-SNAPSHOT~f701ba9d75 1.46.0-SNAPSHOT~e3686d43f6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737867796 1737867796
ci_job_id 780712806 780712806
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-kcmwffss-project-304-concurrent-2-bk5avgat 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-kcmwffss-project-304-concurrent-2-bk5avgat 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049281
Total [baseline] (10.441 s) : 0, 10441308
Agent [candidate] (1.036 s) : 0, 1036401
Total [candidate] (10.426 s) : 0, 10425679
section appsec
Agent [baseline] (1.18 s) : 0, 1179700
Total [baseline] (10.693 s) : 0, 10693296
Agent [candidate] (1.177 s) : 0, 1177231
Total [candidate] (10.697 s) : 0, 10696785
section iast
Agent [baseline] (1.18 s) : 0, 1179627
Total [baseline] (11.037 s) : 0, 11036844
Agent [candidate] (1.178 s) : 0, 1177798
Total [candidate] (10.986 s) : 0, 10985894
section profiling
Agent [baseline] (1.251 s) : 0, 1250771
Total [baseline] (10.786 s) : 0, 10786077
Agent [candidate] (1.25 s) : 0, 1250276
Total [candidate] (10.806 s) : 0, 10806478
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.18 s 130.419 ms (12.4%)
Agent iast 1.18 s 130.345 ms (12.4%)
Agent profiling 1.251 s 201.49 ms (19.2%)
Total tracing 10.441 s -
Total appsec 10.693 s 251.987 ms (2.4%)
Total iast 11.037 s 595.535 ms (5.7%)
Total profiling 10.786 s 344.769 ms (3.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent appsec 1.177 s 140.83 ms (13.6%)
Agent iast 1.178 s 141.397 ms (13.6%)
Agent profiling 1.25 s 213.875 ms (20.6%)
Total tracing 10.426 s -
Total appsec 10.697 s 271.107 ms (2.6%)
Total iast 10.986 s 560.215 ms (5.4%)
Total profiling 10.806 s 380.799 ms (3.7%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.897 ms) : 0, 723897
BytebuddyAgent [candidate] (714.454 ms) : 0, 714454
GlobalTracer [baseline] (241.478 ms) : 0, 241478
GlobalTracer [candidate] (239.354 ms) : 0, 239354
AppSec [baseline] (55.735 ms) : 0, 55735
AppSec [candidate] (55.529 ms) : 0, 55529
Remote Config [baseline] (725.311 µs) : 0, 725
Remote Config [candidate] (710.68 µs) : 0, 711
Telemetry [baseline] (12.281 ms) : 0, 12281
Telemetry [candidate] (11.378 ms) : 0, 11378
section appsec
BytebuddyAgent [baseline] (733.004 ms) : 0, 733004
BytebuddyAgent [candidate] (731.205 ms) : 0, 731205
GlobalTracer [baseline] (236.438 ms) : 0, 236438
GlobalTracer [candidate] (235.995 ms) : 0, 235995
AppSec [baseline] (176.439 ms) : 0, 176439
AppSec [candidate] (175.803 ms) : 0, 175803
Remote Config [baseline] (656.757 µs) : 0, 657
Remote Config [candidate] (665.907 µs) : 0, 666
Telemetry [baseline] (8.206 ms) : 0, 8206
Telemetry [candidate] (8.507 ms) : 0, 8507
IAST [baseline] (20.023 ms) : 0, 20023
IAST [candidate] (20.06 ms) : 0, 20060
section iast
BytebuddyAgent [baseline] (842.447 ms) : 0, 842447
BytebuddyAgent [candidate] (841.359 ms) : 0, 841359
GlobalTracer [baseline] (231.753 ms) : 0, 231753
GlobalTracer [candidate] (232.14 ms) : 0, 232140
AppSec [baseline] (58.908 ms) : 0, 58908
AppSec [candidate] (58.346 ms) : 0, 58346
Remote Config [baseline] (680.049 µs) : 0, 680
Remote Config [candidate] (666.441 µs) : 0, 666
Telemetry [baseline] (8.922 ms) : 0, 8922
Telemetry [candidate] (8.741 ms) : 0, 8741
IAST [baseline] (21.781 ms) : 0, 21781
IAST [candidate] (21.41 ms) : 0, 21410
section profiling
ProfilingAgent [baseline] (94.905 ms) : 0, 94905
ProfilingAgent [candidate] (94.507 ms) : 0, 94507
BytebuddyAgent [baseline] (702.591 ms) : 0, 702591
BytebuddyAgent [candidate] (702.784 ms) : 0, 702784
GlobalTracer [baseline] (347.329 ms) : 0, 347329
GlobalTracer [candidate] (348.09 ms) : 0, 348090
AppSec [baseline] (54.682 ms) : 0, 54682
AppSec [candidate] (53.629 ms) : 0, 53629
Remote Config [baseline] (708.337 µs) : 0, 708
Remote Config [candidate] (713.546 µs) : 0, 714
Telemetry [baseline] (8.734 ms) : 0, 8734
Telemetry [candidate] (8.759 ms) : 0, 8759
Profiling [baseline] (94.929 ms) : 0, 94929
Profiling [candidate] (94.533 ms) : 0, 94533
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1048421
Total [baseline] (8.665 s) : 0, 8664963
Agent [candidate] (1.035 s) : 0, 1034716
Total [candidate] (8.623 s) : 0, 8622519
section iast
Agent [baseline] (1.173 s) : 0, 1172673
Total [baseline] (9.205 s) : 0, 9205086
Agent [candidate] (1.175 s) : 0, 1175214
Total [candidate] (9.237 s) : 0, 9236838
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.165 s) : 0, 1164626
Total [baseline] (9.168 s) : 0, 9167603
Agent [candidate] (1.174 s) : 0, 1174487
Total [candidate] (9.165 s) : 0, 9164665
section iast_TELEMETRY_OFF
Agent [baseline] (1.16 s) : 0, 1159849
Total [baseline] (9.203 s) : 0, 9203014
Agent [candidate] (1.165 s) : 0, 1165245
Total [candidate] (9.273 s) : 0, 9272710
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.173 s 124.252 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.165 s 116.204 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.16 s 111.427 ms (10.6%)
Total tracing 8.665 s -
Total iast 9.205 s 540.123 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.168 s 502.64 ms (5.8%)
Total iast_TELEMETRY_OFF 9.203 s 538.051 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.175 s 140.498 ms (13.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 139.771 ms (13.5%)
Agent iast_TELEMETRY_OFF 1.165 s 130.529 ms (12.6%)
Total tracing 8.623 s -
Total iast 9.237 s 614.318 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.165 s 542.146 ms (6.3%)
Total iast_TELEMETRY_OFF 9.273 s 650.191 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.591 ms) : 0, 722591
BytebuddyAgent [candidate] (713.669 ms) : 0, 713669
GlobalTracer [baseline] (240.849 ms) : 0, 240849
GlobalTracer [candidate] (238.747 ms) : 0, 238747
AppSec [baseline] (55.804 ms) : 0, 55804
AppSec [candidate] (55.186 ms) : 0, 55186
Remote Config [baseline] (730.933 µs) : 0, 731
Remote Config [candidate] (725.833 µs) : 0, 726
Telemetry [baseline] (13.088 ms) : 0, 13088
Telemetry [candidate] (11.38 ms) : 0, 11380
section iast
BytebuddyAgent [baseline] (837.598 ms) : 0, 837598
BytebuddyAgent [candidate] (839.573 ms) : 0, 839573
GlobalTracer [baseline] (230.681 ms) : 0, 230681
GlobalTracer [candidate] (231.121 ms) : 0, 231121
AppSec [baseline] (58.508 ms) : 0, 58508
AppSec [candidate] (58.595 ms) : 0, 58595
IAST [baseline] (21.346 ms) : 0, 21346
IAST [candidate] (21.276 ms) : 0, 21276
Remote Config [baseline] (664.239 µs) : 0, 664
Remote Config [candidate] (659.112 µs) : 0, 659
Telemetry [baseline] (8.792 ms) : 0, 8792
Telemetry [candidate] (8.874 ms) : 0, 8874
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (832.43 ms) : 0, 832430
BytebuddyAgent [candidate] (839.291 ms) : 0, 839291
GlobalTracer [baseline] (229.198 ms) : 0, 229198
GlobalTracer [candidate] (230.387 ms) : 0, 230387
AppSec [baseline] (57.758 ms) : 0, 57758
AppSec [candidate] (58.667 ms) : 0, 58667
IAST [baseline] (20.966 ms) : 0, 20966
IAST [candidate] (21.525 ms) : 0, 21525
Remote Config [baseline] (644.426 µs) : 0, 644
Remote Config [candidate] (664.171 µs) : 0, 664
Telemetry [baseline] (8.643 ms) : 0, 8643
Telemetry [candidate] (8.824 ms) : 0, 8824
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (828.501 ms) : 0, 828501
BytebuddyAgent [candidate] (830.839 ms) : 0, 830839
GlobalTracer [baseline] (228.802 ms) : 0, 228802
GlobalTracer [candidate] (229.979 ms) : 0, 229979
AppSec [baseline] (57.712 ms) : 0, 57712
AppSec [candidate] (58.468 ms) : 0, 58468
IAST [baseline] (20.778 ms) : 0, 20778
IAST [candidate] (21.124 ms) : 0, 21124
Remote Config [baseline] (635.267 µs) : 0, 635
Remote Config [candidate] (1.034 ms) : 0, 1034
Telemetry [baseline] (8.427 ms) : 0, 8427
Telemetry [candidate] (8.676 ms) : 0, 8676
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-26T04:33:20 2025-01-26T04:40:24
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
release_version 1.46.0-SNAPSHOT~f701ba9d75 1.46.0-SNAPSHOT~e3686d43f6
start_time 2025-01-26T04:33:07 2025-01-26T04:40:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737866782 1737866782
ci_job_id 780712807 780712807
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-kcmwffss-project-304-concurrent-3-f3ri304v 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-kcmwffss-project-304-concurrent-3-f3ri304v 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.351 ms) : 1332, 1371
.   : milestone, 1351,
appsec (1.747 ms) : 1723, 1771
.   : milestone, 1747,
appsec_no_iast (1.766 ms) : 1741, 1790
.   : milestone, 1766,
iast (1.509 ms) : 1485, 1533
.   : milestone, 1509,
profiling (1.58 ms) : 1554, 1606
.   : milestone, 1580,
tracing (1.5 ms) : 1476, 1524
.   : milestone, 1500,
section candidate
no_agent (1.37 ms) : 1351, 1390
.   : milestone, 1370,
appsec (1.743 ms) : 1719, 1766
.   : milestone, 1743,
appsec_no_iast (1.759 ms) : 1736, 1782
.   : milestone, 1759,
iast (1.507 ms) : 1483, 1531
.   : milestone, 1507,
profiling (1.536 ms) : 1512, 1560
.   : milestone, 1536,
tracing (1.497 ms) : 1472, 1521
.   : milestone, 1497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.332 ms, 1.371 ms] -
appsec 1.747 ms [1.723 ms, 1.771 ms] 396.215 µs (29.3%)
appsec_no_iast 1.766 ms [1.741 ms, 1.79 ms] 414.64 µs (30.7%)
iast 1.509 ms [1.485 ms, 1.533 ms] 157.573 µs (11.7%)
profiling 1.58 ms [1.554 ms, 1.606 ms] 228.704 µs (16.9%)
tracing 1.5 ms [1.476 ms, 1.524 ms] 149.145 µs (11.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.39 ms] -
appsec 1.743 ms [1.719 ms, 1.766 ms] 372.151 µs (27.2%)
appsec_no_iast 1.759 ms [1.736 ms, 1.782 ms] 388.342 µs (28.3%)
iast 1.507 ms [1.483 ms, 1.531 ms] 136.575 µs (10.0%)
profiling 1.536 ms [1.512 ms, 1.56 ms] 165.648 µs (12.1%)
tracing 1.497 ms [1.472 ms, 1.521 ms] 126.189 µs (9.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.706 µs) : 355, 395
.   : milestone, 375,
iast (503.038 µs) : 481, 525
.   : milestone, 503,
iast_FULL (740.227 µs) : 717, 763
.   : milestone, 740,
iast_GLOBAL (557.864 µs) : 533, 582
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (508.88 µs) : 487, 531
.   : milestone, 509,
iast_INACTIVE (456.588 µs) : 434, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (486.901 µs) : 464, 510
.   : milestone, 487,
tracing (447.856 µs) : 427, 468
.   : milestone, 448,
section candidate
no_agent (379.609 µs) : 360, 399
.   : milestone, 380,
iast (512.836 µs) : 490, 536
.   : milestone, 513,
iast_FULL (742.871 µs) : 721, 765
.   : milestone, 743,
iast_GLOBAL (564.407 µs) : 540, 589
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (511.404 µs) : 488, 535
.   : milestone, 511,
iast_INACTIVE (456.304 µs) : 435, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (497.853 µs) : 474, 521
.   : milestone, 498,
tracing (448.761 µs) : 428, 469
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.706 µs [354.547 µs, 394.865 µs] -
iast 503.038 µs [481.437 µs, 524.638 µs] 128.332 µs (34.2%)
iast_FULL 740.227 µs [717.213 µs, 763.241 µs] 365.521 µs (97.5%)
iast_GLOBAL 557.864 µs [533.323 µs, 582.405 µs] 183.158 µs (48.9%)
iast_HARDCODED_SECRET_DISABLED 508.88 µs [486.761 µs, 530.999 µs] 134.174 µs (35.8%)
iast_INACTIVE 456.588 µs [434.241 µs, 478.936 µs] 81.882 µs (21.9%)
iast_TELEMETRY_OFF 486.901 µs [464.046 µs, 509.756 µs] 112.195 µs (29.9%)
tracing 447.856 µs [427.216 µs, 468.495 µs] 73.149 µs (19.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.609 µs [360.193 µs, 399.026 µs] -
iast 512.836 µs [489.666 µs, 536.006 µs] 133.227 µs (35.1%)
iast_FULL 742.871 µs [721.009 µs, 764.733 µs] 363.261 µs (95.7%)
iast_GLOBAL 564.407 µs [539.656 µs, 589.159 µs] 184.798 µs (48.7%)
iast_HARDCODED_SECRET_DISABLED 511.404 µs [488.238 µs, 534.57 µs] 131.794 µs (34.7%)
iast_INACTIVE 456.304 µs [434.791 µs, 477.818 µs] 76.695 µs (20.2%)
iast_TELEMETRY_OFF 497.853 µs [474.492 µs, 521.215 µs] 118.244 µs (31.1%)
tracing 448.761 µs [428.243 µs, 469.278 µs] 69.151 µs (18.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
release_version 1.46.0-SNAPSHOT~f701ba9d75 1.46.0-SNAPSHOT~e3686d43f6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737867315 1737867315
ci_job_id 780712808 780712808
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xugqgpm8-project-304-concurrent-0-ne5hmpin 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xugqgpm8-project-304-concurrent-0-ne5hmpin 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.362 ms) : 2319, 2405
.   : milestone, 2362,
iast (2.097 ms) : 2043, 2151
.   : milestone, 2097,
iast_GLOBAL (2.142 ms) : 2088, 2197
.   : milestone, 2142,
profiling (1.963 ms) : 1920, 2006
.   : milestone, 1963,
tracing (1.946 ms) : 1904, 1987
.   : milestone, 1946,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.37 ms) : 2327, 2413
.   : milestone, 2370,
iast (2.111 ms) : 2056, 2166
.   : milestone, 2111,
iast_GLOBAL (2.144 ms) : 2090, 2199
.   : milestone, 2144,
profiling (1.967 ms) : 1923, 2010
.   : milestone, 1967,
tracing (1.945 ms) : 1903, 1987
.   : milestone, 1945,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.362 ms [2.319 ms, 2.405 ms] 893.322 µs (60.8%)
iast 2.097 ms [2.043 ms, 2.151 ms] 628.237 µs (42.8%)
iast_GLOBAL 2.142 ms [2.088 ms, 2.197 ms] 673.482 µs (45.9%)
profiling 1.963 ms [1.92 ms, 2.006 ms] 494.227 µs (33.7%)
tracing 1.946 ms [1.904 ms, 1.987 ms] 476.898 µs (32.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.37 ms [2.327 ms, 2.413 ms] 899.108 µs (61.1%)
iast 2.111 ms [2.056 ms, 2.166 ms] 640.688 µs (43.6%)
iast_GLOBAL 2.144 ms [2.09 ms, 2.199 ms] 673.673 µs (45.8%)
profiling 1.967 ms [1.923 ms, 2.01 ms] 496.029 µs (33.7%)
tracing 1.945 ms [1.903 ms, 1.987 ms] 474.658 µs (32.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~e3686d43f6, baseline=1.46.0-SNAPSHOT~f701ba9d75
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.032 s) : 15032000, 15032000
.   : milestone, 15032000,
appsec (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
iast (18.646 s) : 18646000, 18646000
.   : milestone, 18646000,
iast_GLOBAL (18.225 s) : 18225000, 18225000
.   : milestone, 18225000,
profiling (14.964 s) : 14964000, 14964000
.   : milestone, 14964000,
tracing (14.895 s) : 14895000, 14895000
.   : milestone, 14895000,
section candidate
no_agent (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
appsec (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
iast (18.395 s) : 18395000, 18395000
.   : milestone, 18395000,
iast_GLOBAL (18.27 s) : 18270000, 18270000
.   : milestone, 18270000,
profiling (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
tracing (14.918 s) : 14918000, 14918000
.   : milestone, 14918000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.032 s [15.032 s, 15.032 s] -
appsec 15.024 s [15.024 s, 15.024 s] -8.0 ms (-0.1%)
iast 18.646 s [18.646 s, 18.646 s] 3.614 s (24.0%)
iast_GLOBAL 18.225 s [18.225 s, 18.225 s] 3.193 s (21.2%)
profiling 14.964 s [14.964 s, 14.964 s] -68.0 ms (-0.5%)
tracing 14.895 s [14.895 s, 14.895 s] -137.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.971 s [14.971 s, 14.971 s] -
appsec 14.731 s [14.731 s, 14.731 s] -240.0 ms (-1.6%)
iast 18.395 s [18.395 s, 18.395 s] 3.424 s (22.9%)
iast_GLOBAL 18.27 s [18.27 s, 18.27 s] 3.299 s (22.0%)
profiling 15.021 s [15.021 s, 15.021 s] 50.0 ms (0.3%)
tracing 14.918 s [14.918 s, 14.918 s] -53.0 ms (-0.4%)

@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865127
git_commit_sha f701ba9 6a15104
See matching parameters
Baseline Candidate
ci_job_date 1737866396 1737866396
ci_job_id 780712882 780712882
ci_pipeline_id 54001942 54001942
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[+735.558op/s; +7836.390op/s] or [+0.435%; +4.634%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250126
git_commit_date 1737765352 1737865125
git_commit_sha f701ba9 e3686d4
See matching parameters
Baseline Candidate
ci_job_date 1737866473 1737866473
ci_job_id 780712811 780712811
ci_pipeline_id 54001941 54001941
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@anmarchenko anmarchenko Awaiting requested review from anmarchenko anmarchenko is a code owner automatically assigned from DataDog/ci-app-libraries-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
0 participants