Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MEI: Store the results of maintenance effectiveness calculations to get a time series #3716

Closed
jensstutte opened this issue Oct 13, 2023 · 2 comments

Comments

@jensstutte
Copy link

jensstutte commented Oct 13, 2023

Assuming we calculate the values on a weekly base for the following time intervals:

(Yesterday - 1 week, Yesterday)
(Yesterday - 1 month, Yesterday)
(Yesterday - 6 month, Yesterday)
(Yesterday - 12 month, Yesterday)

we should store the results to get a time series of evolution.

In order to be able to reconstruct and aggregate the results, we just need to store the basic input values, resulting in a set of:

NumOpenedDefects(Component, TimeInterval)
NumClosedDefects(Component, TimeInterval)
NumOpenDefects(Component, End(TimeInterval))
WeighedOpenedDefects(Component, TimeInterval)
WeighedClosedDefects(Component, TimeInterval)
WeighedOpenDefects(Component, End(TimeInterval))

Note that this assumes that Component is a good minimum granularity. We could segment this further by:

ExternalReporter
Fuzzerfound
Intermittent
Other

provided that we ensure that the categories do not overlap to be still able to correctly aggregate numbers (each defect must be counted only once for a given time interval and execution time).

@jensstutte
Copy link
Author

jensstutte commented Oct 13, 2023

If we want to leave us the possibility to adjust weights or even add new severity levels, instead of storing the weighed numbers we could also just store:

NumOpenedDefects(DefectCategory, Component, Severity, TimeInterval)
NumClosedDefects(DefectCategory, Component, Severity, TimeInterval)
NumOpenDefects(DefectCategory, Component, Severity, End(TimeInterval))

for each possible/existing value of severity. That would give us the maximum flexibility to use this data as we like.

@marco-c
Copy link
Collaborator

marco-c commented Oct 13, 2023

We have discussed about this on Slack, and we agreed it'd make more sense to calculate it dynamically instead of storing the values.
This is an approximation of course, some bugs will change in severity and component, but we've decided this is a good thing because it reflects reality more (e.g. if a bug was moved from S3 to S2, the WeighedOpenDefects for last year we calculate today is higher than the WeighedOpenDefects we would have calculated last year, but it is a good thing because the actual severity of the bug is S2 and should have likely been S2 since the beginning).

@marco-c marco-c closed this as not planned Won't fix, can't repro, duplicate, stale Oct 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants