Tempo - Metrics Generator Outage
Resolved
The issue affecting Tempo (prod-us-east-0 & prod-us-west-0) and Loki (prod-us-central-5) has been fully resolved.
Metrics generation is now operating normally across all regions, and we continue to monitor for stability.
Update
We’ve identified that Loki clusters in prod-us-central-5 were also affected by the same underlying issue impacting Tempo in prod-us-east-0.
Querying and ingestion remained fully operational throughout. The issue has been mitigated and services are stabilizing.
Update
We’re investigating an issue in Tempo prod-us-east-0 and prod-us-west-0 that began around 19:00 UTC on Oct 30, causing a total outage for metrics generation.
This affects Tempo metrics generation, but Tempo query and ingestion remain fully operational.
Engineering is actively engaged and assessing the issue. We will provide updates accordingly.