Increase in 429s for Git Operations


Incident resolved in 1h23m36s

Resolved

Public Summary DraftBetween July 28, 2025 16:31 UTC to July 29, 2025 12:05 UTC users saw degraded Git Operations for raw file downloads. On average, the error rate was .005%, with a peak error rate of 3.89%. This was due to a sustained increase in unauthenticated repository traffic.We mitigated the incident by applying regional rate limiting, rolling back a service that was unable to scale with the additional traffic, and addressed a bug that impacted the caching of raw requests. Additionally, we horizontally scaled several dependencies of the service to appropriately handle the increase in traffic.We are working on improving our time to detection and have implemented controls to prevent similar incidents in future.

1753790717

Investigating

Continued monitoring is showing that impact has been mitigated and normal service operation has been restored.We are going to resolve the incident at this time. Thank you for your patience as we investigated this problem.

1753790711

Investigating

We identified and removed unhealthy hosts from our system. This has led to a reduction of 429s and a return to normal operating conditions.We are continuing to monitor recovery and will resolve the incident once we are confident the impact has been mitigated.

1753788743

Investigating

We are seeing an increase in 429s when retrieving git artifacts from GitHub.com. This is manifesting in many ways, for example, in failed GitHub Actions workflow runs.We have our engineers working on mitigation and we will provide more information as we have it. Thank you for your patience.

1753786814

Investigating

We are investigating reports of degraded performance for Actions and Git Operations

1753785701