Loki prod-ap-northeast-0-loki-prod-030 writes degradation
Loki prod-ap-northeast-0-loki-prod-030 cell had writes degradation between 8:11 - 8:58 AM UTC. The engineering team mitigated the situation and the cell is stable now.
Incident History
Alerts failing with prometheus
This incident has been resolved.
Synthetic Monitoring is down in prod-us-central-7
This incident has been resolved.
Longer Than Expected Load Times on Grafana Cloud
We continue to observe a continued period of recovery. At this time, we are considering this issue resolved. No further updates.
Some Loki Writes in Prod-Gb-South-0 Failed
This incident has been resolved.
Slow user queries exceeds threshold
This incident has been resolved.
Elevated Read & Write Latency for Some Cells in Prod-Us-East-0
This incident has been resolved.
Intermittent issues when starting k6 cloud test runs
We are experiencing issues starting cloud test runs. This is primarily affecting browser test runs and test runs using static IPs.
Missing Billing Metrics for Loki
An incident has impacted Loki billing metrics from 05:30 to 06:10 UTC across all clusters. This is currently resolved, however, users may notice some billing metrics missing from the billing dashboard during this time period. There is no impact of logs querying or ingestion.
Hosted grafana is currently being impacted as a result of the Cloudflare outage
This incident has been resolved.