PDC Queries in Prod-Us-East-3 Are Failing
This incident has been resolved.
Incident History
New K6 Tests Intermittently Failing
This incident has been resolved.
Logs write path degradation on GCP Belgium - prod-eu-west-0
Today 17th from 10:00 UTC to 10:38 UTC we experienced logs write path degradation. Customers may have experienced 5xx errors while ingestion on that cluster. Service is fully restored.
IRM access issues on instances in GCP Belgium (prod-eu-west-0)
Due to an incident today in IRM (OnCall) product, access to this application was degraded from 10:39 UTC until 11:16. Customers may have experienced the app not operable or not accessible. The service is again fully restored.
k6 Cloud service is down
This incident has been resolved.
Some Trace QL Queries Failing
This incident has been resolved.
Mimir Partial Write Outage
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.
Elevated Log Push Failures and Latency on prod-eu-west-0 cluster
Users experienced failed log pushes as well as increased latency when sending logs to Loki service hosted on prod-eu-west-0 cluster between 18:30 UTC to ~23:00 UTC.
Our engineering team has engaged our Cloud Service Provider and the fix was implemented that mitigated the issue.
Elevated Metric Push Failures and Latency
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.
Metrics read issue affecting cortex-prod-13 on prod-us-east-0
The incident has been resolved.