Incident History

Synthetic monitoring connectivity issue between AWS US West (us-west-0) region and Singapore probe

Today between 07:45 UTC and 08:50 UTC, the Singapore probe experienced a regional networking issue and lost connectivity with the AWS US West region. During this time Singapore was unable to publish metric and log results from synthetic test executions to AWS US West (us-west-0). Synthetic tests targeting that region also saw elevated error rates. We haven’t observed any connectivity issues since 08:50AM UTC consider this incident resolved. If you continue to experience problems, please open a Support ticket for assistance.

1718804806 - 1718804806 Resolved

Tempo Instability in Prod-us-central-0

We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.

1718743324 - 1719268688 Resolved

Pyroscope is unavailable in Azure US Central

As of 8:10 UTC, we have observed marked improvement with the availability of Pyroscope. Customers should be able to access Pyroscope in the Azure US Central cluster now.

1718264544 - 1718266374 Resolved

Increased Timeouts for Queries

This incident has been resolved. All queries should perform as expected.

1718139995 - 1718403317 Resolved

Increased Timeouts for Queries

This incident has been resolved.

1718122608 - 1718124187 Resolved

Some Rule Alert Evaluation Failures

From approximately 13:32 UTC to 14:14 UTC, there was a partial read outage of Loki-managed recording rules. Customers in the prod-us-west-0 region may have experienced gaps in recording rules and alerts configured with Loki.

1717772753 - 1717772753 Resolved

cortex-prod-13 query frontend crashlooping

This incident has been resolved.

1717626873 - 1717626873 Resolved

Some Grafana Cloud Instances Intermittently Unavailable

This incident has been resolved.

1717446368 - 1718128610 Resolved

Synthetic Monitoring: networking issues with the Singapore probe

Connection issues between Grafana Cloud regions and the Singapore probe are resolved.

1717421492 - 1717512162 Resolved

Issues Accessing some Grafana Cloud Instances

This incident has been resolved.

1717410937 - 1717416180 Resolved
⮜ Previous Next ⮞