Incident with Actions


Incident resolved in 3h15m29s

Resolved

On October 21, 2025, between 07:55 UTC and 12:20 UTC, GitHub Actions experienced degraded performance. During this time, 2.11% workflow runs failed to start within 5 minutes, with an average delay of 8.2 minutes. The root cause was increased latency on a node in one of our Redis clusters, triggered by resource contention after a patching event became stuck. Recovery began once the patching process was unstuck and normal connectivity to the Redis cluster was restored at 11:45 UTC, but it took until 12:20 UTC to clear the backlog of queued work. We are implementing safeguards to prevent this failure mode and enhancing our monitoring to detect and address problems like this more quickly in the future.

1761049699

Investigating

We were able to apply a mitigation and we are now seeing recovery.

1761047950

Investigating

We are seeing about 10% of Actions runs taking longer than 5 minutes to start, we're still investigating and will provide an update by 12:00 UTC.

1761046674

Investigating

We are still seeing delays in starting some Actions runs and are currently investigating. We will provide updates as we have more information.

1761040747

Investigating

We are seeing delays in starting some Actions runs and are currently investigating.

1761038738

Investigating

We are investigating reports of degraded performance for Actions

1761037970