Actions Larger Runners Provisioning Delays


Incident resolved in 2h45m37s

Resolved

Between Feb 5, 2025 00:34 UTC and 11:16 UTC, up to 7% of organizations using GitHub-hosted larger runners with public IP addresses had those jobs fail to start during the impact window. The issue was caused by a backend migration in the public IP management system, which caused certain public IP address runners to be placed in a non-functioning state.We have improved the rollback steps for this migration to reduce the time to mitigate any future recurrences, are working to improve automated detection of this error state, and are improving the resiliency of runners to handle this error state without customer impact.

1738755872

Investigating

We have identified a configuration change that we believe may be related. We are working to mitigate.

1738754275

Investigating

We are continuing investigation

1738751620

Investigating

We continue to investigate and have determined this is limited to a subset of larger runner pools.

1738749411

Investigating

We are investigating an incident where Actions larger runners are stuck in provisioning for some customers

1738747273

Investigating

We are currently investigating this issue.

1738745935