Grafana Cloud IRM alert groups failing to produce alerts in us-east-3 region.

Resolved

We haven't noticed any further issues in this region for alert group processing since yesterday. This incident i fully resolved.

Update

The work on bringing services back to healthy state is completed and alerts should be created correctly, without a delay now. We're keeping the incident open and monitoring for any potential hiccups that might occur.

Update

Some IRM alert groups in us-east-3 region may not be able to produce alerts and could be sluggish/misbehaving in general. The issue started around 01:00 UTC on July 3rd. The issue has been identified and the cause of the issue has been fixed. Our team is actively working on getting the service back to healthy state.