Not possible to create stacks on prod-us-west-0
The stack creation process is now functioning properly in the prod-us-west-0 region.
Incident History
prod-us-central-3 prod-us-central-4 clusters are unavailable
This incident has been resolved.
Some Grafana Instances Taking Longer to Initialize
This incident has been resolved.
Some Grafana Instances Taking Longer to Initialize
This incident has been resolved.
Tests failures on k6
This incident has been resolved.
Issue with Grafana Access in prod-ap-south-1 and prod-ap-northeast-0
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved.
Degraded performance when querying metrics on AWS Germany
On 12th of March, between 13:30 UTC and 13:50 UTC we experienced some degraded performance when querying metrics on the AWS Germany cluster. The effects were reflected in unavailability to see metrics on dashboards and alert queries triggering errors during that period. The issue has been resolved.
Delay in aggregated series through adaptive metrics
All series are now caught up and the incident is resolved.
Write path down in prod-us-east-2-prometheus-prod-56
This incident has been resolved.
Read errors in prod-eu-west-0
Many ingesters were evicted from nodes in cortex-prod-01 at once causing a read path outage. Once the ingesters were rescheduled the read path recovered. The errors lasted about 10 minutes.