You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
The acceptance tests are difficult to make reliable and deterministic and so the idea came up to collect their results so we can maybe have a better "feel" of an outcome. We could compare the current run against previous ones. Maybe it helps identifying real problems and distinguishing between more serious ones and just flaky tests.
Describe the solution you'd like
I think it would be great to see the previous results on Graphana somehow. Depending on how things are setup, maybe we can send some simple statsd lines from the test runner to whatever collects the data. I would send the outcome of each test (failed, succeeded) as well as their running time.
Describe alternatives you've considered
n.a.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
The acceptance tests are difficult to make reliable and deterministic and so the idea came up to collect their results so we can maybe have a better "feel" of an outcome. We could compare the current run against previous ones. Maybe it helps identifying real problems and distinguishing between more serious ones and just flaky tests.
Describe the solution you'd like
I think it would be great to see the previous results on Graphana somehow. Depending on how things are setup, maybe we can send some simple statsd lines from the test runner to whatever collects the data. I would send the outcome of each test (failed, succeeded) as well as their running time.
Describe alternatives you've considered
n.a.
The text was updated successfully, but these errors were encountered: