Skip to content

Commit

Permalink
Add validation report for 2024-07-30
Browse files Browse the repository at this point in the history
Signed-off-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
  • Loading branch information
dependabot[bot] committed Jul 31, 2024
1 parent 1c82916 commit 0501675
Show file tree
Hide file tree
Showing 18 changed files with 45 additions and 44 deletions.
1 change: 1 addition & 0 deletions docs/kepler-model-validation.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,3 +57,4 @@ Don't edit the following table manually. It is generated by the CI.
| 2024-07-30 | v0.7.11-43-g19c6afdc | [Report](validation/2024-07-30/report-v0.7.11-43-g19c6afdc.md) | [Artifacts](validation/2024-07-30/validator-v0.7.11-43-g19c6afdc) |
| 2024-07-30 | v0.7.11-51-ga070cd5f | [Report](validation/2024-07-30/report-v0.7.11-51-ga070cd5f.md) | [Artifacts](validation/2024-07-30/validator-v0.7.11-51-ga070cd5f) |
| 2024-07-30 | v0.7.11-53-g9d090590 | [Report](validation/2024-07-30/report-v0.7.11-53-g9d090590.md) | [Artifacts](validation/2024-07-30/validator-v0.7.11-53-g9d090590) |
| 2024-07-30 | v0.7.11-53-g9d090590 | [Report](validation/2024-07-30/report-v0.7.11-53-g9d090590.md) | [Artifacts](validation/2024-07-30/validator-v0.7.11-53-g9d090590) |
56 changes: 28 additions & 28 deletions docs/validation/2024-07-30/report-v0.7.11-53-g9d090590.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,11 @@

## Build Info

* `kepler_exporter_build_info{arch="amd64", branch="main", instance="localhost:8888", job="node", os="linux", revision="9d090590c35f8a025575622f6def1b008199b2f9", version="v0.7.11-53-g9d090590"}`
* `kepler_exporter_build_info{arch="amd64", branch="main", instance="localhost:8888", job="metal", os="linux", revision="9d090590c35f8a025575622f6def1b008199b2f9", version="v0.7.11-53-g9d090590"}`
* `kepler_exporter_build_info{arch="amd64", branch="main", instance="localhost:9999", job="vm", os="linux", revision="9d090590c35f8a025575622f6def1b008199b2f9", version="v0.7.11-53-g9d090590"}`
## Node Info

* `kepler_node_info{components_power_source="rapl-sysfs", cpu_architecture="Coffee Lake", instance="localhost:8888", job="node", platform_power_source="acpi", source="os"}`
* `kepler_node_info{components_power_source="rapl-sysfs", cpu_architecture="Coffee Lake", instance="localhost:8888", job="metal", platform_power_source="acpi", source="os"}`
* `kepler_node_info{components_power_source="estimator", cpu_architecture="Coffee Lake", instance="localhost:9999", job="vm", platform_power_source="none", source="os"}`
## Specs
### Host CPU Specs
Expand All @@ -24,75 +24,75 @@
### VM DRAM Size
| Size |
|------|
| 32601200 kB |
| 32601204 kB |

## Validation Results

* Started At: `2024-07-30 20:11:30.713426`
* Ended At: `2024-07-30 20:14:51.653984`
* Duration : `0:03:20.940558`
* Started At: `2024-07-30 20:45:23.557831`
* Ended At: `2024-07-30 20:48:44.415270`
* Duration : `0:03:20.857439`

### Validate - platform - dynamic

* expected: `rate( kepler_node_platform_joules_total{ job="vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_platform_joules_total{ job="node", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_platform_joules_total{ job="metal", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
#### Errors

* MSE: 1563.5053658130632
* MSE: 1677.9683570273935
* MAPE: inf
### Validate - package - dynamic

* expected: `rate( kepler_node_package_joules_total{ job="vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_package_joules_total{ job="node", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_package_joules_total{ job="metal", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
#### Errors

* MSE: 1083.6922467402715
* MAPE: 60.67393557932456
* MSE: 1134.6474278453509
* MAPE: 61.40343943968888
### Validate - core - dynamic

* expected: `rate( kepler_node_core_joules_total{ job="vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_core_joules_total{ job="node", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_core_joules_total{ job="metal", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
#### Errors

* MSE: 1091.1548280274012
* MAPE: 60.75980176020157
* MSE: 1143.8132859717564
* MAPE: 61.49539414240559
### Validate - dram - dynamic

* expected: `rate( kepler_node_dram_joules_total{ job="vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_dram_joules_total{ job="node", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
* actual: `rate( kepler_vm_dram_joules_total{ job="metal", vm_id=~".*my-vm", mode="dynamic", }[20s] ) `
#### Errors

* MSE: 23.694634566251384
* MSE: 25.428438773454516
* MAPE: inf
### Validate - platform - idle

* expected: `rate( kepler_node_platform_joules_total{ job="vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_platform_joules_total{ job="node", vm_id=~".*my-vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_platform_joules_total{ job="metal", vm_id=~".*my-vm", mode="idle", }[20s] ) `
#### Errors

* MSE: 5674703129.572374
* MAPE: 99.70742001673504
* MSE: 5504117338.886709
* MAPE: 99.70293362802494
### Validate - package - idle

* expected: `rate( kepler_node_package_joules_total{ job="vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_package_joules_total{ job="node", vm_id=~".*my-vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_package_joules_total{ job="metal", vm_id=~".*my-vm", mode="idle", }[20s] ) `
#### Errors

* MSE: 4867.900284382244
* MAPE: 47523.47769246675
* MSE: 4869.012073312447
* MAPE: 50322.87344846842
### Validate - core - idle

* expected: `rate( kepler_node_core_joules_total{ job="vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_core_joules_total{ job="node", vm_id=~".*my-vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_core_joules_total{ job="metal", vm_id=~".*my-vm", mode="idle", }[20s] ) `
#### Errors

* MSE: 4871.2461412910125
* MAPE: 56821.9317369549
* MSE: 4872.335614193842
* MAPE: 60774.47528122025
### Validate - dram - idle

* expected: `rate( kepler_node_dram_joules_total{ job="vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_dram_joules_total{ job="node", vm_id=~".*my-vm", mode="idle", }[20s] ) `
* actual: `rate( kepler_vm_dram_joules_total{ job="metal", vm_id=~".*my-vm", mode="idle", }[20s] ) `
#### Errors

* MSE: 2218.006202263879
* MAPE: 101473.68331973984
* MSE: 2218.0773057359693
* MAPE: 103467.58256910136
Original file line number Diff line number Diff line change
@@ -1 +1 @@
{"query": "rate( kepler_node_core_joules_total{ job=\"vm\", mode=\"dynamic\", }[20s] ) ", "metric": {"exported_instance": "my-vm", "instance": "localhost:9999", "job": "vm", "mode": "dynamic", "package": "0", "source": "trained_power_model"}, "timestamps": [1722384691, 1722384694, 1722384697, 1722384700, 1722384703, 1722384706, 1722384709, 1722384712, 1722384715, 1722384718, 1722384721, 1722384724, 1722384727, 1722384730, 1722384733, 1722384736, 1722384739, 1722384742, 1722384745, 1722384748, 1722384751, 1722384754, 1722384757, 1722384760, 1722384763, 1722384766, 1722384769, 1722384772, 1722384775, 1722384778, 1722384781, 1722384784, 1722384787, 1722384790, 1722384793, 1722384796, 1722384799, 1722384802, 1722384805, 1722384808, 1722384811, 1722384814, 1722384817, 1722384820, 1722384823, 1722384826, 1722384829, 1722384832, 1722384835, 1722384838, 1722384841, 1722384844, 1722384847, 1722384850, 1722384853, 1722384856, 1722384859, 1722384862, 1722384865, 1722384868, 1722384871, 1722384874, 1722384877, 1722384880, 1722384883, 1722384886, 1722384889, 1722384892], "values": [0.02620524104820969, 0.014999999999999621, 0.05900000000000034, 0.058599999999999854, 0.8294000000000001, 1.945210957808438, 2.8230000000000004, 4.338867773554711, 5.234000000000001, 5.3232, 6.129225845169035, 7.827999999999999, 9.0114, 11.12594172944863, 13.2896, 13.560599999999999, 14.0746, 11.335532893421313, 14.443325776770234, 18.0512, 22.0126, 24.3816, 30.581116223244656, 29.6502, 25.000999999999998, 27.947410517896422, 31.155999999999995, 36.58559999999999, 39.74365126974604, 46.860400000000006, 47.4122824564913, 43.189, 42.38239999999999, 39.594518903780774, 42.7762, 44.879400000000004, 51.2768, 53.554489102179566, 60.8122375524895, 59.967999999999996, 59.54349130173966, 54.11420000000001, 50.626200000000004, 46.95159031806361, 44.596999999999994, 43.208241648329654, 44.90959999999998, 35.631326265253044, 30.88422315536894, 28.990399999999983, 25.721399999999992, 24.113800000000023, 30.236352729454136, 30.07741548309662, 23.839000000000002, 20.434113177364548, 16.797199999999975, 14.132226445289048, 13.022063724836688, 15.376600000000023, 14.898199999999997, 13.942600000000008, 11.00339932013596, 8.787414172388488, 7.284399999999975, 5.645199999999992, 6.0573999999999915, 6.47929585917184]}
{"query": "rate( kepler_node_core_joules_total{ job=\"vm\", mode=\"dynamic\", }[20s] ) ", "metric": {"exported_instance": "my-vm", "instance": "localhost:9999", "job": "vm", "mode": "dynamic", "package": "0", "source": "trained_power_model"}, "timestamps": [1722386724, 1722386727, 1722386730, 1722386733, 1722386736, 1722386739, 1722386742, 1722386745, 1722386748, 1722386751, 1722386754, 1722386757, 1722386760, 1722386763, 1722386766, 1722386769, 1722386772, 1722386775, 1722386778, 1722386781, 1722386784, 1722386787, 1722386790, 1722386793, 1722386796, 1722386799, 1722386802, 1722386805, 1722386808, 1722386811, 1722386814, 1722386817, 1722386820, 1722386823, 1722386826, 1722386829, 1722386832, 1722386835, 1722386838, 1722386841, 1722386844, 1722386847, 1722386850, 1722386853, 1722386856, 1722386859, 1722386862, 1722386865, 1722386868, 1722386871, 1722386874, 1722386877, 1722386880, 1722386883, 1722386886, 1722386889, 1722386892, 1722386895, 1722386898, 1722386901, 1722386904, 1722386907, 1722386910, 1722386913, 1722386916, 1722386919, 1722386922], "values": [0.02733029663370722, 0.026833333333333168, 0.05533333333333346, 0.060340037781975685, 1.0536666666666663, 2.0041666666666664, 3.087343038115346, 4.1062104210643255, 4.9623333333333335, 5.699833333333333, 5.395567159204535, 6.917833333333335, 7.577658037995779, 9.099177686409602, 10.752833333333333, 13.065548272414178, 15.18852094677186, 14.475558271303187, 18.32186909656628, 21.075000000000003, 23.060104432840802, 25.359484387154122, 26.80216666666667, 31.26047338593177, 32.408500000000004, 34.30783333333334, 36.9092676964107, 39.492278635707144, 42.64616666666667, 43.93216666666667, 37.343684035107216, 35.351166666666664, 36.475780468836795, 38.51294588287587, 47.34566666666666, 49.918286857015886, 58.301144571619055, 64.22436395956005, 65.50927880875652, 66.33350000000002, 50.63016666666669, 48.11884653850428, 47.89700000000001, 44.16507389709969, 41.68166666666667, 39.434, 46.22683333333334, 40.11116666666668, 37.53133333333335, 34.214999999999996, 33.20916666666666, 28.909333333333358, 27.913565159426735, 30.5305, 25.985666666666628, 24.51766666666668, 21.24333333333334, 19.812131985334933, 16.010445605067225, 14.644333333333332, 13.463004110654417, 12.007999999999964, 9.93222975224976, 7.839204356039567, 6.856999999999972, 4.86266666666663, 5.9999999999999645]}
Original file line number Diff line number Diff line change
@@ -1 +1 @@
{"query": "rate( kepler_node_core_joules_total{ job=\"vm\", mode=\"idle\", }[20s] ) ", "metric": {"exported_instance": "my-vm", "instance": "localhost:9999", "job": "vm", "mode": "idle", "package": "0", "source": "trained_power_model"}, "timestamps": [1722384691, 1722384694, 1722384697, 1722384700, 1722384703, 1722384706, 1722384709, 1722384712, 1722384715, 1722384718, 1722384721, 1722384724, 1722384727, 1722384730, 1722384733, 1722384736, 1722384739, 1722384742, 1722384745, 1722384748, 1722384751, 1722384754, 1722384757, 1722384760, 1722384763, 1722384766, 1722384769, 1722384772, 1722384775, 1722384778, 1722384781, 1722384784, 1722384787, 1722384790, 1722384793, 1722384796, 1722384799, 1722384802, 1722384805, 1722384808, 1722384811, 1722384814, 1722384817, 1722384820, 1722384823, 1722384826, 1722384829, 1722384832, 1722384835, 1722384838, 1722384841, 1722384844, 1722384847, 1722384850, 1722384853, 1722384856, 1722384859, 1722384862, 1722384865, 1722384868, 1722384871, 1722384874, 1722384877, 1722384880, 1722384883, 1722384886, 1722384889, 1722384892], "values": [69.93098619723949, 69.91699999999997, 69.917, 69.917, 69.91700000000003, 69.90301939612071, 69.917, 69.93098619723946, 69.917, 69.917, 69.93098619723946, 69.917, 69.917, 69.92166144409629, 69.91699999999994, 69.917, 69.917, 69.90301939612078, 69.92632350980125, 69.917, 69.91700000000007, 69.91699999999994, 69.9309861972394, 69.917, 69.917, 69.90301939612071, 69.91700000000007, 69.91700000000007, 69.90301939612084, 69.91700000000007, 69.9309861972394, 69.91699999999994, 69.91699999999994, 69.9309861972394, 69.91699999999994, 69.91700000000007, 69.91700000000007, 69.90301939612084, 69.90301939612084, 69.91699999999994, 69.90301939612071, 69.91699999999994, 69.91699999999994, 69.9309861972394, 69.91700000000007, 69.93098619723952, 69.91700000000007, 69.9309861972394, 69.90301939612071, 69.91699999999994, 69.91699999999994, 69.91699999999994, 69.90301939612084, 69.93098619723952, 69.91700000000007, 69.90301939612084, 69.91699999999994, 69.9309861972394, 69.90767897613647, 69.91700000000007, 69.91700000000007, 69.91699999999994, 69.90301939612071, 69.91233917738812, 69.91699999999983, 69.91699999999983, 69.91700000000007, 69.93098619723952]}
{"query": "rate( kepler_node_core_joules_total{ job=\"vm\", mode=\"idle\", }[20s] ) ", "metric": {"exported_instance": "my-vm", "instance": "localhost:9999", "job": "vm", "mode": "idle", "package": "0", "source": "trained_power_model"}, "timestamps": [1722386724, 1722386727, 1722386730, 1722386733, 1722386736, 1722386739, 1722386742, 1722386745, 1722386748, 1722386751, 1722386754, 1722386757, 1722386760, 1722386763, 1722386766, 1722386769, 1722386772, 1722386775, 1722386778, 1722386781, 1722386784, 1722386787, 1722386790, 1722386793, 1722386796, 1722386799, 1722386802, 1722386805, 1722386808, 1722386811, 1722386814, 1722386817, 1722386820, 1722386823, 1722386826, 1722386829, 1722386832, 1722386835, 1722386838, 1722386841, 1722386844, 1722386847, 1722386850, 1722386853, 1722386856, 1722386859, 1722386862, 1722386865, 1722386868, 1722386871, 1722386874, 1722386877, 1722386880, 1722386883, 1722386886, 1722386889, 1722386892, 1722386895, 1722386898, 1722386901, 1722386904, 1722386907, 1722386910, 1722386913, 1722386916, 1722386919, 1722386922], "values": [69.90923230752139, 69.917, 69.91700000000002, 69.92476941882433, 69.917, 69.91699999999997, 69.92476941882433, 69.9092323075214, 69.91700000000002, 69.91699999999997, 69.9092323075214, 69.91700000000002, 69.9092323075214, 69.92476941882427, 69.91699999999997, 69.9092323075214, 69.92476941882433, 69.90923230752136, 69.92476941882427, 69.91700000000007, 69.90923230752136, 69.92476941882427, 69.91699999999997, 69.92476941882433, 69.91700000000002, 69.91699999999997, 69.92476941882437, 69.90923230752146, 69.91700000000007, 69.91699999999997, 69.90923230752136, 69.91699999999997, 69.90923230752136, 69.92476941882427, 69.91699999999997, 69.90923230752146, 69.92476941882437, 69.90923230752146, 69.92476941882427, 69.91699999999997, 69.91699999999997, 69.92476941882427, 69.91699999999997, 69.92476941882427, 69.91700000000007, 69.91700000000007, 69.91699999999997, 69.91699999999997, 69.91699999999997, 69.91699999999997, 69.91699999999997, 69.91699999999997, 69.90923230752146, 69.91700000000007, 69.91700000000007, 69.91699999999997, 69.91699999999997, 69.90923230752136, 69.92476941882437, 69.91700000000007, 69.90923230752126, 69.91699999999997, 69.90923230752136, 69.92476941882427, 69.91699999999987, 69.91699999999987, 69.92476941882437]}
Original file line number Diff line number Diff line change
@@ -1 +1 @@
{"query": "rate( kepler_node_dram_joules_total{ job=\"vm\", mode=\"dynamic\", }[20s] ) ", "metric": {"exported_instance": "my-vm", "instance": "localhost:9999", "job": "vm", "mode": "dynamic", "package": "0", "source": "trained_power_model"}, "timestamps": [1722384691, 1722384694, 1722384697, 1722384700, 1722384703, 1722384706, 1722384709, 1722384712, 1722384715, 1722384718, 1722384721, 1722384724, 1722384727, 1722384730, 1722384733, 1722384736, 1722384739, 1722384742, 1722384745, 1722384748, 1722384751, 1722384754, 1722384757, 1722384760, 1722384763, 1722384766, 1722384769, 1722384772, 1722384775, 1722384778, 1722384781, 1722384784, 1722384787, 1722384790, 1722384793, 1722384796, 1722384799, 1722384802, 1722384805, 1722384808, 1722384811, 1722384814, 1722384817, 1722384820, 1722384823, 1722384826, 1722384829, 1722384832, 1722384835, 1722384838, 1722384841, 1722384844, 1722384847, 1722384850, 1722384853, 1722384856, 1722384859, 1722384862, 1722384865, 1722384868, 1722384871, 1722384874, 1722384877, 1722384880, 1722384883, 1722384886, 1722384889, 1722384892], "values": [0.004400880176035256, 0.00259999999999998, 0.009600000000000008, 0.009600000000000008, 0.13399999999999998, 0.3139372125574884, 0.4554000000000001, 0.699739947989598, 0.844, 0.8582000000000001, 0.9881976395279057, 1.262, 1.4527999999999999, 1.7937195813054203, 2.1426, 2.1862, 2.2689999999999997, 1.8274345130973804, 2.328310441392186, 2.91, 3.5486, 3.9306, 4.929985997199441, 4.779999999999999, 4.030399999999999, 4.505298940211956, 5.0224, 5.897799999999999, 6.406918616276745, 7.554200000000001, 7.643128625725146, 6.962399999999999, 6.832399999999999, 6.382876575315062, 6.8958, 7.235000000000002, 8.2662, 8.633273345330934, 9.803239352129575, 9.6672, 9.59868026394721, 8.7236, 8.161399999999999, 7.569113822764551, 7.1894, 6.965593118623723, 7.239800000000006, 5.744148829765953, 4.978804239152169, 4.673600000000003, 4.146599999999997, 3.8873999999999946, 4.874225154969008, 4.848569713942793, 3.842799999999996, 3.2939412117576548, 2.707800000000005, 2.278255651130221, 2.0993200906545813, 2.479000000000004, 2.4017999999999953, 2.2475999999999963, 1.7738452309538129, 1.4167055529631325, 1.174399999999999, 0.9102000000000013, 0.9768000000000029, 1.0448089617923575]}
{"query": "rate( kepler_node_dram_joules_total{ job=\"vm\", mode=\"dynamic\", }[20s] ) ", "metric": {"exported_instance": "my-vm", "instance": "localhost:9999", "job": "vm", "mode": "dynamic", "package": "0", "source": "trained_power_model"}, "timestamps": [1722386724, 1722386727, 1722386730, 1722386733, 1722386736, 1722386739, 1722386742, 1722386745, 1722386748, 1722386751, 1722386754, 1722386757, 1722386760, 1722386763, 1722386766, 1722386769, 1722386772, 1722386775, 1722386778, 1722386781, 1722386784, 1722386787, 1722386790, 1722386793, 1722386796, 1722386799, 1722386802, 1722386805, 1722386808, 1722386811, 1722386814, 1722386817, 1722386820, 1722386823, 1722386826, 1722386829, 1722386832, 1722386835, 1722386838, 1722386841, 1722386844, 1722386847, 1722386850, 1722386853, 1722386856, 1722386859, 1722386862, 1722386865, 1722386868, 1722386871, 1722386874, 1722386877, 1722386880, 1722386883, 1722386886, 1722386889, 1722386892, 1722386895, 1722386898, 1722386901, 1722386904, 1722386907, 1722386910, 1722386913, 1722386916, 1722386919, 1722386922], "values": [0.004499500055549357, 0.004333333333333399, 0.009000000000000046, 0.00983442604733857, 0.16983333333333336, 0.3231666666666667, 0.4978886542949215, 0.6620931007665816, 0.7999999999999999, 0.9188333333333335, 0.869903344072881, 1.1153333333333335, 1.2216975891567605, 1.4669963329258806, 1.7336666666666667, 2.106432618597934, 2.448605400600066, 2.3335740473280744, 2.953494832759195, 3.397333333333333, 3.7172536384846135, 4.087954217135236, 4.320500000000001, 5.039226580731191, 5.224333333333334, 5.530500000000001, 5.949827758639849, 6.366292634151763, 6.874666666666665, 7.082000000000001, 6.019997778024665, 5.698833333333333, 5.880179980002223, 6.208523169241025, 7.632500000000003, 8.047105877124766, 9.398377597510834, 10.35318297966893, 10.560340037781975, 10.693166666666666, 8.161666666666669, 7.756861873541501, 7.72116666666667, 7.119624402711409, 6.719333333333332, 6.357000000000003, 7.451999999999999, 6.4661666666666715, 6.050166666666662, 5.5155, 5.353333333333334, 4.660166666666669, 4.499666703699585, 4.9215, 4.189000000000003, 3.9523333333333364, 3.4244999999999983, 3.193811798689029, 2.580953439271036, 2.360833333333334, 2.170258860126651, 1.935833333333335, 1.6011554271747623, 1.2638070896766358, 1.1055000000000001, 0.7839999999999981, 0.9674408267585305]}
Loading

0 comments on commit 0501675

Please sign in to comment.