Issues with Library Panels
This incident has been resolved.
Incident History
Issues in prod-us-east-0 with Alertmanager and Rule Evaluations
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved.
Synthetic monitoring connectivity issue in Toronto probe
This incident has been resolved.
Span and Service Graph Metrics delayed in AWS Singapore (prod-ap-southeast-1)
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.
Synthetic monitoring connectivity issue between AWS US West (us-west-0) region and Singapore probe
Today between 07:45 UTC and 08:50 UTC, the Singapore probe experienced a regional networking issue and lost connectivity with the AWS US West region. During this time Singapore was unable to publish metric and log results from synthetic test executions to AWS US West (us-west-0). Synthetic tests targeting that region also saw elevated error rates. We haven’t observed any connectivity issues since 08:50AM UTC consider this incident resolved. If you continue to experience problems, please open a Support ticket for assistance.
Tempo Instability in Prod-us-central-0
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.
Pyroscope is unavailable in Azure US Central
As of 8:10 UTC, we have observed marked improvement with the availability of Pyroscope. Customers should be able to access Pyroscope in the Azure US Central cluster now.
Increased Timeouts for Queries
This incident has been resolved. All queries should perform as expected.
Increased Timeouts for Queries
This incident has been resolved.
Some Rule Alert Evaluation Failures
From approximately 13:32 UTC to 14:14 UTC, there was a partial read outage of Loki-managed recording rules. Customers in the prod-us-west-0 region may have experienced gaps in recording rules and alerts configured with Loki.