Major GCP Incident Affecting Multiple Grafana Cloud Components (Including AWS and Azure deployed Instances)

Resolved

We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.

Update

Google's engineering team have identified the root cause and applied appropriate mitigations, customers should no longer experience performance issues with Grafana Cloud products. We will continue to monitor for recurrence and provide updates accordingly.

Investigating

The scope of this incident may be affecting all components in Grafana Cloud regardless of deployment region. This includes Alerting amongst all other products.

Investigating

Our CDN provider, Fastly, is also impacted by the GCP outage, and this prevents the loading of all of the static files required. Users already logged in and with locally cached assets are unaffected.

Investigating

After initial investigation, the scope of this issue may lead to users experiencing degraded performance across all of Grafana Cloud products.

Investigating

As of 17:55 UTC, we were alerted a significant outage involving one of our cloud providers. Users experiencing this issue may encounter inability to query or ingest data for metrics, logs, traces, and profiles. Users experiencing this issue may also not be able to create new Hosted Grafana instances.

Engineering is actively engaged and assessing the issue. We will provide updates accordingly.