Incident with multiple GitHub services

Resolved

On June 17, 2025, between 19:32 UTC and 20:03 UTC, an internal routing policy deployment to a subset of network devices caused reachability issues for certain network address blocks within our datacenters. Authenticated users of the github.com UI experienced 3-4% error rates for the duration. Authenticated callers of the API experienced 40% error rates. Unauthenticated requests to the UI and API experienced nearly 100% error rates for the duration. Actions service experienced 2.5% of runs being delayed for an average of 8 minutes and 3% of runs failing. Large File Storage (LFS) requests experienced 0.978% errors. At 19:54 UTC, the deployment was rolled back, and network availability for the affected systems was restored. At 20:03 UTC, we fully restored normal operations. To prevent similar issues, we are expanding our validation process for routing policy changes.

Investigating

Actions is operating normally.

Investigating

Codespaces is experiencing degraded performance. We are continuing to investigate.

Investigating

Webhooks is operating normally.

Investigating

Pull Requests is operating normally.

Investigating

API Requests is operating normally.

Investigating

Issues is operating normally.

Investigating

API Requests is experiencing degraded performance. We are continuing to investigate.

Investigating

We experienced problems with multiple services, causing disruptions for some users. We have identified the cause and are rolling out changes to restore normal service. Many services are recovering, but full recovery is ongoing.

Investigating

Copilot is operating normally.

Investigating

Pages is operating normally.

Investigating

Pull Requests is experiencing degraded performance. We are continuing to investigate.

Investigating

Pull Requests is experiencing degraded availability. We are continuing to investigate.

Investigating

Copilot is experiencing degraded performance. We are continuing to investigate.

Investigating

Actions is experiencing degraded performance. We are continuing to investigate.

Investigating

Webhooks is experiencing degraded performance. We are continuing to investigate.

Investigating

We are investigating reports of issues with many services impacting segments of customers. We will continue to keep users updated on progress towards mitigation.

Investigating

API Requests is experiencing degraded availability. We are continuing to investigate.

Investigating

API Requests is experiencing degraded performance. We are continuing to investigate.

Investigating

Pages is experiencing degraded performance. We are continuing to investigate.

Investigating

Copilot is experiencing degraded availability. We are continuing to investigate.

Investigating

Issues is experiencing degraded performance. We are continuing to investigate.

Investigating

We are investigating reports of degraded performance for Copilot