Chrome 125 results #1682

krausest · 2024-05-18T07:12:41Z

krausest
May 18, 2024
Maintainer

Results for chrome 125 are published. I'm happy to report that it was much smoother than chrome 124.

There a a lot of alternative vanillajs versions in this run. I promise to clean up but that'll happen later 😄

We're using Chrome for Testing 125.0.6422.60 for this run.

Attached you find a binary build of all frameworks such that you can run the benchmark without installing and building all frameworks (see README for how to use the build.zip)

This discussion was created from the release Chrome 125 results.

syduki · 2024-05-25T23:25:17Z

syduki
May 25, 2024

I'm afraid I don't have the same experience with Chrome 125 as you. I am struggling to get consistent results due to an annoying popup which was not there before Chrome 125:

This popup is random, it may show up at any time during a run, or not show at all in some runs, but when it shows it stay there for some time which causes a 15-20% performance drop for all iterations in that time slot for a certain test, for example on my machine in "create 1000 rows" vanillajs test it spoils around 3 iterations.

Here is the output for a such run, which include the iteration when popup is not yet visible and second one when popup became visible:

Output

initBenchmark
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
after initialized 01_run1k 0 vanillajs-lite
Waiting for 0 ms
Waiting for 50 ms
Waiting for 0 ms
Waiting for 0 ms
runBenchmark
after run 01_run1k 0 vanillajs-lite
Waiting for 0 ms
Waiting for 100 ms
one mousedown event traces/vanillajs-lite-keyed_01_run1k_9.json
mousedownToClick 751 traces/vanillajs-lite-keyed_01_run1k_9.json
**** resultScript = 6.429
duration for vanillajs-lite and 01_run1k: {"tsStart":194564925955,"tsEnd":194565141106,"duration":215.151,"layouts":1,"raf_long_delay":0,"droppedNonMainProcessCommitEvents":false,"droppedNonMainProcessOtherEvents":false,"maxDeltaBetweenCommits":0,"numberCommits":1}
Waiting for 0 ms
initBenchmark
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
Waiting for 0 ms
after initialized 01_run1k 0 vanillajs-lite
Waiting for 0 ms
Waiting for 50 ms
Waiting for 0 ms
Waiting for 0 ms
runBenchmark
after run 01_run1k 0 vanillajs-lite
Waiting for 0 ms
Waiting for 100 ms
one mousedown event traces/vanillajs-lite-keyed_01_run1k_10.json
mousedownToClick 707 traces/vanillajs-lite-keyed_01_run1k_10.json
INFO: Dropping commit events from other processes traces/vanillajs-lite-keyed_01_run1k_10.json
event commit -239250 - -239077 {"args":{"frameSeqId":2259,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":173,"name":"Commit","ph":"X","pid":245079,"tdur":179,"tid":245079,"ts":194568079497,"tts":3704118}
event commit -222651 - -222418 {"args":{"frameSeqId":2260,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":233,"name":"Commit","ph":"X","pid":245079,"tdur":235,"tid":245079,"ts":194568096096,"tts":3708303}
event commit -206892 - -206668 {"args":{"frameSeqId":2262,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":224,"name":"Commit","ph":"X","pid":245079,"tdur":224,"tid":245079,"ts":194568111855,"tts":3711226}
event commit -191539 - -191509 {"args":{"frameSeqId":2263,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":30,"name":"Commit","ph":"X","pid":245079,"tdur":29,"tid":245079,"ts":194568127208,"tts":3713164}
event commit -173611 - -173397 {"args":{"frameSeqId":2264,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":214,"name":"Commit","ph":"X","pid":245079,"tdur":216,"tid":245079,"ts":194568145136,"tts":3714955}
event commit -157326 - -157116 {"args":{"frameSeqId":2265,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":210,"name":"Commit","ph":"X","pid":245079,"tdur":212,"tid":245079,"ts":194568161421,"tts":3717506}
event commit -139712 - -139552 {"args":{"frameSeqId":2266,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":160,"name":"Commit","ph":"X","pid":245079,"tdur":160,"tid":245079,"ts":194568179035,"tts":3720471}
event commit -123555 - -123348 {"args":{"frameSeqId":2267,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":207,"name":"Commit","ph":"X","pid":245079,"tdur":208,"tid":245079,"ts":194568195192,"tts":3722895}
event commit -106465 - -106331 {"args":{"frameSeqId":2268,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":134,"name":"Commit","ph":"X","pid":245079,"tdur":135,"tid":245079,"ts":194568212282,"tts":3725893}
event commit -89644 - -89510 {"args":{"frameSeqId":2269,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":134,"name":"Commit","ph":"X","pid":245079,"tdur":135,"tid":245079,"ts":194568229103,"tts":3728552}
event commit -73624 - -73566 {"args":{"frameSeqId":2270,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":58,"name":"Commit","ph":"X","pid":245079,"tdur":57,"tid":245079,"ts":194568245123,"tts":3730456}
event commit -56998 - -56874 {"args":{"frameSeqId":2271,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":124,"name":"Commit","ph":"X","pid":245079,"tdur":125,"tid":245079,"ts":194568261749,"tts":3732521}
event commit -40154 - -40044 {"args":{"frameSeqId":2272,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":110,"name":"Commit","ph":"X","pid":245079,"tdur":110,"tid":245079,"ts":194568278593,"tts":3735028}
event commit -23789 - -23639 {"args":{"frameSeqId":2273,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":150,"name":"Commit","ph":"X","pid":245079,"tdur":150,"tid":245079,"ts":194568294958,"tts":3737620}
event commit -14946 - -14911 {"args":{"frameSeqId":2274,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":35,"name":"Commit","ph":"X","pid":245079,"tdur":36,"tid":245079,"ts":194568303801,"tts":3740708}
event commit 1838 - 1965 {"args":{"frameSeqId":2275,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":127,"name":"Commit","ph":"X","pid":245079,"tdur":127,"tid":245079,"ts":194568320585,"tts":3745253}
event commit 27000 - 27137 {"args":{"frameSeqId":2277,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":137,"name":"Commit","ph":"X","pid":245079,"tdur":137,"tid":245079,"ts":194568345747,"tts":3747600}
event commit 43110 - 43246 {"args":{"frameSeqId":2278,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":136,"name":"Commit","ph":"X","pid":245079,"tdur":136,"tid":245079,"ts":194568361857,"tts":3749689}
event commit 60004 - 60167 {"args":{"frameSeqId":2279,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":163,"name":"Commit","ph":"X","pid":245079,"tdur":163,"tid":245079,"ts":194568378751,"tts":3752034}
event commit 76856 - 77010 {"args":{"frameSeqId":2280,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":154,"name":"Commit","ph":"X","pid":245079,"tdur":154,"tid":245079,"ts":194568395603,"tts":3754448}
event commit 92576 - 92628 {"args":{"frameSeqId":2281,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":52,"name":"Commit","ph":"X","pid":245079,"tdur":52,"tid":245079,"ts":194568411323,"tts":3755959}
event commit 109896 - 110028 {"args":{"frameSeqId":2282,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":132,"name":"Commit","ph":"X","pid":245079,"tdur":132,"tid":245079,"ts":194568428643,"tts":3757538}
event commit 126225 - 126375 {"args":{"frameSeqId":2283,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":150,"name":"Commit","ph":"X","pid":245079,"tdur":150,"tid":245079,"ts":194568444972,"tts":3759668}
event commit 143615 - 143806 {"args":{"frameSeqId":2284,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":191,"name":"Commit","ph":"X","pid":245079,"tdur":192,"tid":245079,"ts":194568462362,"tts":3762209}
event commit 160934 - 161154 {"args":{"frameSeqId":2286,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":220,"name":"Commit","ph":"X","pid":245079,"tdur":220,"tid":245079,"ts":194568479681,"tts":3764937}
event commit 177098 - 177345 {"args":{"frameSeqId":2287,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":247,"name":"Commit","ph":"X","pid":245079,"tdur":249,"tid":245079,"ts":194568495845,"tts":3767462}
event commit 193718 - 193923 {"args":{"frameSeqId":2288,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":205,"name":"Commit","ph":"X","pid":245079,"tdur":203,"tid":245079,"ts":194568512465,"tts":3770808}
event commit 209515 - 209575 {"args":{"frameSeqId":2289,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":60,"name":"Commit","ph":"X","pid":245079,"tdur":62,"tid":245079,"ts":194568528262,"tts":3772432}
event commit 226822 - 226929 {"args":{"frameSeqId":2290,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":107,"name":"Commit","ph":"X","pid":245079,"tdur":108,"tid":245079,"ts":194568545569,"tts":3773909}
event commit 243507 - 243653 {"args":{"frameSeqId":2291,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":146,"name":"Commit","ph":"X","pid":245079,"tdur":147,"tid":245079,"ts":194568562254,"tts":3776325}
event commit 261169 - 261407 {"args":{"frameSeqId":2292,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":238,"name":"Commit","ph":"X","pid":245079,"tdur":238,"tid":245079,"ts":194568579916,"tts":3779234}
event commit 276941 - 277050 {"args":{"frameSeqId":2293,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":109,"name":"Commit","ph":"X","pid":245079,"tdur":108,"tid":245079,"ts":194568595688,"tts":3782240}
event commit 296211 - 296474 {"args":{"frameSeqId":2294,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":263,"name":"Commit","ph":"X","pid":245079,"tdur":236,"tid":245079,"ts":194568614958,"tts":3785847}
event commit 311024 - 311384 {"args":{"frameSeqId":2295,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":360,"name":"Commit","ph":"X","pid":245079,"tdur":361,"tid":245079,"ts":194568629771,"tts":3788758}
event commit 327488 - 327673 {"args":{"frameSeqId":2296,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":185,"name":"Commit","ph":"X","pid":245079,"tdur":186,"tid":245079,"ts":194568646235,"tts":3791787}
event commit 345386 - 345488 {"args":{"frameSeqId":2298,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":102,"name":"Commit","ph":"X","pid":245079,"tdur":102,"tid":245079,"ts":194568664133,"tts":3794234}
event commit 361642 - 361841 {"args":{"frameSeqId":2299,"layerTreeId":1},"cat":"disabled-by-default-devtools.timeline","dur":199,"name":"Commit","ph":"X","pid":245079,"tdur":200,"tid":245079,"ts":194568680389,"tts":3796631}
**** resultScript = 7.866
duration for vanillajs-lite and 01_run1k: {"tsStart":194568318747,"tsEnd":194568560834,"duration":242.087,"layouts":1,"raf_long_delay":0,"droppedNonMainProcessCommitEvents":true,"droppedNonMainProcessOtherEvents":false,"maxDeltaBetweenCommits":0,"numberCommits":1}

I have compiled the puppeteerAccess.ts to include the --ash-no-nudges flag, as noted here, but to no avail.

Here is the startBrowser function in my modified puppeteerAccess.ts file, it includes also additional flags (from here) and changes which I thought would align with #1687:

export async function startBrowser(benchmarkOptions: BenchmarkOptions): Promise<puppeteer.Browser> {
  const width = 1280;
  const height = 800;
  const window_width = width,
    window_height = height;

  const disableFeatures = `
    InterestFeedContentSuggestions
    IPH_DemoMode
    BackForwardCache
    OptimizationHints
    OptimizationHintsFetching
    OptimizationTargetPrediction
    PrivacySandboxSettings4
    Translate
  `.match(/\w+/g).join();

  const args = [
    "--flag-switches-begin",
    `--window-size=${window_width},${window_height}`,
    "--js-flags=--expose-gc,--random-seed=1234567890",
    "--no-default-browser-check",
    "--disable-sync",
    "--no-first-run",
    "--disable-extensions",
    `--disable-features=${disableFeatures}`,
    "--disable-client-side-phishing-detection",
    "--disable-component-extensions-with-background-pages",
    "--disable-chrome-tracing-computation",
    "--disable-input-event-activation-protection",
    "--disable-v8-idle-tasks",
    "--reset-variation-state",
    "--reset-browsing-instance-between-tests",
    "--ash-no-nudges",
    "--aggressive-cache-discard",
    "--disable-back-forward-cache",
    "--enable-precise-memory-info",
    "--disable-background-networking",
    "--disable-component-update",
    "--disable-domain-reliability",
    "--disable-backgrounding-occluded-windows",
    "--flag-switches-end"
  ];
  if (benchmarkOptions.headless) args.push("--headless=new");

  const browser = await puppeteer.launch({
    headless: false,
    executablePath: browserPath(benchmarkOptions),
    ignoreDefaultArgs: true,
    args,
    dumpio: false,
    defaultViewport: {
      width,
      height,
    },
  });
  return browser;
}

and here is the runtime environment with all those flags:

@krausest did you observed this popup during the tests of Chrome 125?

0 replies

krausest · 2024-05-26T07:10:48Z

krausest
May 26, 2024
Maintainer Author

Yeah, I noticed that yesterday when I tried #1687. I didn't notice when doing the chrome 125 full run, but that should not say it wasn't there.
I found adding the following flags helps "--disable-first-run-ui" and added that: 13c5846

During the chrome 124 troubles I took a look at the chrome flags that were more or less random at that time (or at least I couldn't tell if leaving away some of them made a difference) and decided to go only with flags that I think are absolutely necessary. This makes it IMO more reasonable and keeps it closer to a real chrome instance. Thus I'd rather not take your list (though it's good to see that you compiled it) as long as I don't find a reason to do so.
If there are some flags you like to see added for a particular reason please let me know.

https://peter.sh/experiments/chromium-command-line-switches/ seems to be the go to place for chrome command arguments.

0 replies

krausest · 2024-05-26T08:06:13Z

krausest
May 26, 2024
Maintainer Author

Oh no, I was wrong. I thought --disable-first-run-ui removed the popup, but it doesn't help!

0 replies

syduki · 2024-05-26T09:14:45Z

syduki
May 26, 2024

I was a little ashamed to find out that I have overlooked such a descriptive flag 😅, as I have looked through that site during my "research", but thought I missed it while visually scanning all those highly packed flags along with their esoteric description. Now I was almost ready to test it, but your last comment saved me from one more shot of anger 😄. Anyway, it seems that flag is obsolete according to this thread. Thus I am staying with my findings that --ash-no-nudges is the flag for disabling such kind of popups, just may happen that this is a brand new type of popup not yet "sanitized" by this flag.

0 replies

krausest · 2024-05-26T10:24:07Z

krausest
May 26, 2024
Maintainer Author

Actually I ran into it when I added a await wait(2000); after line 97 in forkedBenchmarkRunnerPuppeteer.ts.
This makes the popup appear every time.
No option I tried so far avoided that.
Chrome 125 up to 127 all show that behaviour.

0 replies

krausest · 2024-05-26T12:28:11Z

krausest
May 26, 2024
Maintainer Author

I opened #1688 for that please and maybe I found a workaround. Looking forward to hearing if it works for you. Please report in #1688 if so or if you see some negative side effects.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Chrome 125 results #1682

{{title}}

Replies: 6 comments

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Chrome 125 results #1682

krausest May 18, 2024 Maintainer

Replies: 6 comments

syduki May 25, 2024

krausest May 26, 2024 Maintainer Author

krausest May 26, 2024 Maintainer Author

syduki May 26, 2024

krausest May 26, 2024 Maintainer Author

krausest May 26, 2024 Maintainer Author

krausest
May 18, 2024
Maintainer

syduki
May 25, 2024

krausest
May 26, 2024
Maintainer Author

krausest
May 26, 2024
Maintainer Author

syduki
May 26, 2024

krausest
May 26, 2024
Maintainer Author

krausest
May 26, 2024
Maintainer Author