Incident History

Longer Than Expected Load Times on Grafana Cloud

A fix has been implemented, and we are seeing latency down across clusters. We are continuing to monitor progress.

1763740050 Ongoing

Some Loki Writes in Prod-Gb-South-0 Failed

This incident has been resolved.

1763735524 - 1763739502 Resolved

Slow user queries exceeds threshold

This incident has been resolved.

1763726951 - 1763736728 Resolved

Elevated Read & Write Latency for Some Cells in Prod-Us-East-0

This incident has been resolved.

1763658727 - 1763664459 Resolved

Intermittent issues when starting k6 cloud test runs

We are experiencing issues starting cloud test runs. This is primarily affecting browser test runs and test runs using static IPs.

1763656531 - 1763656531 Resolved

Missing Billing Metrics for Loki

An incident has impacted Loki billing metrics from 05:30 to 06:10 UTC across all clusters. This is currently resolved, however, users may notice some billing metrics missing from the billing dashboard during this time period. There is no impact of logs querying or ingestion.

1763533239 - 1763533239 Resolved

Hosted grafana is currently being impacted as a result of the Cloudflare outage

This incident has been resolved.

1763467158 - 1763487286 Resolved

Elevated Mimir Read/Write Errors

We continue to observe a continued period of recovery. As of 00:08 UTC, we are considering this issue resolved. No further updates.

1763418139 - 1763424603 Resolved

Metrics Write Outage in Multiple Cells

As of 23:07 UTC we are considering this incident as resolved.

Mitigation efforts have restored normal write performance, and error rates have returned to expected levels.

We have confirmed stability across the affected areas and continue to monitor, but no further impact is expected.

If you continue to experience any issues, please reach out to support.

1763409762 - 1763420920 Resolved

Hyderabad Probe Issues

We experienced degraded service with the Hyderabad probe today around 13:20 UTC which was resolved as of 17:30 UTC.

1763406104 - 1763406104 Resolved
⮜ Previous