✨ Grafana integration to MLOps work

[mshodge]

Describe the feature request.

Getting ahead of myself here in terms of MLOps, but always worth highlighting user needs as early as possible. In the MLOps lifecycle, monitoring of deployed ML models is important. You need to know if the model is behaving as expected, and have alerts in place if it isn't. 'Behaving' could be an accuracy score, or latency, or another user-defined metric. Anyway, there are plenty of monitoring tools out there but seen as Grafana is already being used, I thought we could leverage the knowledge of this and think about how to include it as a ML model monitoring tool.

Describe the context.

I am starting my role as MLOps coordinator from next week. Therefore I am highlighting MLOps needs as early as possible in the hopes that they can be made possible during my six month stint.

Value / Purpose

Deployed ML models need monitoring, especially those used in operational settings where early intervention in poor model performance is vital for the sake of the operational tool.

User Types

Data Scientists doing ML

[Ed-Bajo]

Meeting to be held with the MLOps team to ascertain requirements and current state.
Linked tickets:

• ✨ Feast and Feast UI on the AP #3369
• ♻ Refactor App list pages within control panel #3378
• https://github.com/ministryofjustice/data-platform-support/issues/527

[github-actions]

This issue is being marked as stale because it has been open for 60 days with no activity. Remove stale label or comment to keep the issue open.

[github-actions]

This issue is being closed because it has been open for a further 7 days with no activity. If this is still a valid issue, please reopen it, Thank you!