Ingestion Errors for AWS Cloud Provider Observability Metric Streams in prod-us-central-7
This incident has been resolved.
Incident History
Performance Testing – Degraded Service (Resolved)
We experienced degraded performance affecting Performance Testing from 13:10 UTC to 13:20 UTC. During this time, users may not have been able to start new test runs.
The issue has been resolved, and the service is now operating normally.
We apologize for any disruption this may have caused and appreciate your patience.
Elevated write latency for AWS Metrics Streaming integration in us-east-3 region.
We were facing an incident with AWS Metrics Streaming integration in us-east-3 region manifesting in elevated ingestion latency. The incident started at around 10:45 UTC and was resolved at around 12:30 UTC. Some tenants could see an elevated write latency, but all requests were being processed and we don't expect any data loss during the time of the incident.
The incident is now resolved, but we keep monitoring the system's health.
Investigating Issues Saving SQL Datasource Credentials
This incident has been resolved. Thank you for your patience.
Gateway Slowness Detected in Prod (US-East-1)
After further review, this was a false alarm and should not have affected any users.
This incident has been resolved. Thank you for your patience.
InfluxDB Datasource - Intermittent Failures
This incident has been resolved. Thank you for your patience.
Cloudwatch Datasource Outage
This incident has been resolved. Thank you for your patience.
Restrictions on Alerts & Reports for Grafana Cloud Free/Trial Users
Grafana Labs has taken steps to safeguard the Grafana Cloud platform against the distribution of unauthorized emails. We have implemented the following changes to new Grafana Cloud Free and Trial accounts, effective immediately:
Users who open Grafana Cloud Free and Trial accounts can only send email alerts and reports to users within their Grafana instance. Other email recipients will be rejected. Additionally, the Cloud Alertmanager is no longer available for these instances, requiring all alerting to be configured via the native Grafana Alertmanager. All other integrations for alerting remain functional.
If users would like to expand their email capabilities, they can upgrade their Grafana Cloud account to scale their use case, as needed.
These changes to alerting and reporting will be applied to all new Grafana Cloud Free and Trial accounts. Existing Grafana Cloud Free and Trial accounts opened before April 20 and all other Grafana Cloud account types are unaffected by these changes.
Elevated 429 Errors Impacting Metrics Querying Across Multiple Regions
This incident has been resolved. Thank you for your patience.
Query Caching - Degraded Performance
This incident has been resolved