Create Grafana dashboard

[miparnisari]

People have been asking for a Grafana dashboard: 1, 2, 3, 4

We have one now: https://github.com/authzed/spicedb/blob/main/development/grafana/dashboards/dashboard.json

but we should update it with the metrics that are important to keep an eye out for. We know best what metrics are important.

• datastore connections
• cache hit ratio
• anything else?

Once it's ready, we could publish it to https://grafana.com/grafana/dashboards/.

As a stretch goal, we could also write alarms.

[jzelinskie]

IIRC we had one in the examples repo, is that what's currently checked in to this repo now?

I think having equivalent metrics for what's available in AuthZed Cloud & Dedicated makes the most sense from a DX and maintenance perspective

[miparnisari]

Is that what's currently checked in to this repo now?

No. The existing dashboard is one I created from scratch while I was trying to run load tests to reproduce panics.

I think having equivalent metrics for what's available in AuthZed Cloud & Dedicated makes the most sense from a DX and maintenance perspective

Yes!