feat(grafana): add grafana support

[edobry]

Description

This PR builds on the previously-added Prometheus support to add Grafana support by:

• adding a grafana_params section to the top-level observability parameter section
• deploying a Grafana server
• implementing dashboard provisioning

The grafana module from the ethereum-package package was used as inspiration, but modified to simplify devX by removing support for inline dashboards and improving remote dashboard source support.

Additionally, this PR implements API provisioning using the official grizzly tool, over the existing file-based provisioning approach to simplify the process of keeping Kurtosis Grafana in-sync with hosted Grafana. To this end, two new repositories (grafana-dashboards, grafana-dashboards-public) have been created, with the intention of tracking extant public & private dashboards in hosted Grafana.

This PR has been tested and successfully deploys a Grafana server with including all public dashboards present on our hosted Grafana instance, organized into the same folder structure:

Not all dashboards are yet at full parity, but a fair number of them do show data:

If you want to try this out locally, add the following snippet to your params file:

optimism_package:
  observability:
    grafana_params:
      dashboard_sources:
        - github.com/ethereum-optimism/grafana-dashboards-public/resources@aa35389fc5dec4043838757e2372368c3efb0a29

Remaining work:

• continue converging metrics to enable additional dashboards
• implement promtail/loki support to enable log-based dashboard panels
• deploy any services required for certain dashboards (ie replica-healthcheck) (?)
• support a subset of existing dashboards using tags/folders
• automatic updates of the grafana-dashboards repository

[axelKingsley]

I won't leave an Approval here, since I am very inexperienced with Kurtosis &co, but looking over the premise, this seems to be what we want, a grafana deployment that comes up just after prometheus, and uses some existing dashboard definition.

Left minor comments, but generally excited for this one!

[parithosh]

is the link https://github.com/ethereum-optimism/grafana-dashboards valid? it returns 404 for me

[scharissis]

is the link https://github.com/ethereum-optimism/grafana-dashboards valid? it returns 404 for me

Yes. Valid, but internal/private to optimism.

[scharissis]

LGTM - nice one!
Just left a few questions/ideas.
(I've also observed this working live in a demonstration from you)

[edobry]

@scharissis thanks for the review, I'll include these changes in a follow-up PR to avoid needing to get CI approval again on this one