Grafana Cloud having a datasource with PDC enabled using localhost address are getting 403 status responses.
The incident has been resolved.
Incident History
MS SQL Data source unavailable for production instances on Daily or Instant RRC
Engineering has released a fix and as of 19:20 UTC, customers should no longer experience any issues with the MS SQL plugin. At this time, we are considering this issue resolved. No further updates.
Tempo Query Failures in AWS Clusters
The fix has been rolled out and issue has been reoslved.
Degraded Reads in Loki
At approximately ~11:30 UTC some customers in the prod-us-east-0 region experienced either extremely slow Loki queries, or Loki queries not returning at all. This lasted until ~ 15:30 UTC when the fix was rolled out.
Grafana OnCall degraded perfomance
This incident has been resolved.
k6: Operational issue
This incident has been resolved.
Slow access to OnCall UI and delayed notifications for prod-us-central-0 cluster
Engineering has released a fix and as of Thu Oct 3rd, around 23:00 UTC, customers should no longer experience delays while accessing OnCall UI. At this time, we are considering this issue resolved. No further updates.
Synthetic monitoring failures, London probe location
This incident has been resolved.
Grafana Cloud Partial Outage
No further instances of this issue have been detected following our mitigation. Customers should no longer experience any downtime. At this time, we are considering this issue resolved. No further updates.
Synthetic Monitoring: London and Mumbai probes temporary disruption of service
A transient stability issue in our infrastructure caused public probes to report MultiHTTP and Scripted checks as failures in:
- Mumbai between September 28th ~15:30 UTC to ~17:00 UTC
- London between September 30th ~23:30 UTC to October 1st ~02:30 UTC
The error has been addressed and all probes should now be operating normally.