Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PR tests reporting #5356

Merged
merged 18 commits into from
Feb 3, 2025
Merged

PR tests reporting #5356

merged 18 commits into from
Feb 3, 2025

Conversation

szczecha
Copy link
Member

@szczecha szczecha commented Jan 16, 2025

Scope of the change

I want to have test reports available in PRs and measure flaky tests
This PR adds a new PW reporter https://github.com/ctrf-io/playwright-ctrf-json-reporter
and publish test summary https://github.com/ctrf-io/github-test-reporter to PRs

Next, we will collect data form PRs and enable option for historical data:
fail-rate-report
flaky-rate-report
previous-results-report
and add reporting for other workflows

Copy link

changeset-bot bot commented Jan 16, 2025

🦋 Changeset detected

Latest commit: 8cfa425

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
saleor-dashboard Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link

github-actions bot commented Jan 16, 2025

Differences Found

⚠️ 1 packages or licenses were added.

Expand
License	Package
MIT	playwright-ctrf-json-reporter

Summary

Expand
License Name Package Count Packages
0BSD 1
Packages
  • tslib
BlueOak-1.0.0 1
Packages
  • path-scurry
CC0-1.0 1
Packages
  • type-fest
MIT/X11 1
Packages
  • nub
MPL-1.1 1
Packages
  • harmony-reflect
MPL-2.0 1
Packages
  • dompurify
Public Domain 1
Packages
  • jsonify
Python-2.0 1
Packages
  • argparse
WTFPL 1
Packages
  • opener
CC-BY-4.0 2
Packages
  • @saleor/macaw-ui
  • caniuse-lite
<<missing>> 3
Packages
  • busboy
  • saleor-dashboard
  • streamsearch
BSD-2-Clause 24
Packages
  • @typescript-eslint/parser
  • @typescript-eslint/typescript-estree
  • browser-process-hrtime
  • css-select
  • css-what
  • domelementtype
  • domhandler
  • domutils
  • dotenv
  • dotenv-expand
  • entities
  • escodegen
  • eslint-scope
  • espree
  • esprima
  • esrecurse
  • estraverse
  • esutils
  • nth-check
  • stringify-object
  • And 4 more...
BSD-3-Clause 45
Packages
  • @humanwhocodes/object-schema
  • @sentry/cli
  • @sentry/cli-darwin
  • @sentry/cli-linux-arm
  • @sentry/cli-linux-arm64
  • @sentry/cli-linux-i686
  • @sentry/cli-linux-x64
  • @sentry/cli-win32-i686
  • @sentry/cli-win32-x64
  • @sinonjs/commons
  • @sinonjs/fake-timers
  • abab
  • asn1js
  • babel-plugin-istanbul
  • charenc
  • chroma-js
  • crypt
  • diff
  • esquery
  • exenv
  • And 25 more...
Apache-2.0 46
Packages
  • @ampproject/remapping
  • @editorjs/editorjs
  • @humanwhocodes/config-array
  • @humanwhocodes/module-importer
  • @opentelemetry/api
  • @opentelemetry/semantic-conventions
  • @playwright/test
  • @swc/core
  • @swc/core-darwin-arm64
  • @swc/core-darwin-x64
  • @swc/core-linux-arm-gnueabihf
  • @swc/core-linux-arm64-gnu
  • @swc/core-linux-arm64-musl
  • @swc/core-linux-x64-gnu
  • @swc/core-linux-x64-musl
  • @swc/core-win32-arm64-msvc
  • @swc/core-win32-ia32-msvc
  • @swc/core-win32-x64-msvc
  • @swc/counter
  • aria-query
  • And 26 more...
ISC 50
Packages
  • @esbuild-plugins/node-globals-polyfill
  • @istanbuljs/load-nyc-config
  • @saleor/app-sdk
  • anymatch
  • boolbase
  • browser-stdout
  • cli-width
  • cliui
  • electron-to-chromium
  • fastq
  • flatted
  • fs.realpath
  • get-caller-file
  • get-own-enumerable-property-symbols
  • glob
  • glob-parent
  • graceful-fs
  • inflight
  • inherits
  • ini
  • And 30 more...
MIT 1124
Packages
  • @adobe/css-tools
  • @apollo/client
  • @ardatan/relay-compiler
  • @ardatan/sync-fetch
  • @babel/code-frame
  • @babel/compat-data
  • @babel/core
  • @babel/generator
  • @babel/helper-annotate-as-pure
  • @babel/helper-compilation-targets
  • @babel/helper-create-class-features-plugin
  • @babel/helper-member-expression-to-functions
  • @babel/helper-module-imports
  • @babel/helper-module-transforms
  • @babel/helper-optimise-call-expression
  • @babel/helper-plugin-utils
  • @babel/helper-replace-supers
  • @babel/helper-simple-access
  • @babel/helper-skip-transparent-expression-wrappers
  • @babel/helper-string-parser
  • And 1104 more...

@github-actions github-actions bot temporarily deployed to pr-5356 January 16, 2025 14:24 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 16, 2025 14:30 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 16, 2025 15:30 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 16, 2025 15:50 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 16, 2025 17:57 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 08:28 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 09:41 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 10:01 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 12:58 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 13:18 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 13:38 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 14:09 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 14:33 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 14:57 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 17, 2025 15:22 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 20, 2025 07:25 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 20, 2025 07:47 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 20, 2025 08:14 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 January 31, 2025 13:49 Destroyed
@github-actions github-actions bot temporarily deployed to pr-5356 February 3, 2025 08:56 Destroyed
@szczecha szczecha merged commit a008040 into main Feb 3, 2025
20 checks passed
@szczecha szczecha deleted the qag-270 branch February 3, 2025 13:45
szczecha added a commit that referenced this pull request Feb 3, 2025
andrzejewsky pushed a commit that referenced this pull request Feb 3, 2025
@szczecha szczecha restored the qag-270 branch February 3, 2025 14:08
@szczecha szczecha mentioned this pull request Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants