Incident with Actions


Incident resolved in 19m3s

Resolved

On November 19, between 17:36 UTC and 18:04 UTC, GitHub Actions service experienced degraded performance that caused excessive latency in queueing and updating workflow runs and job statuses. Operations related to artifacts, cache, job steps and logs also had significantly increased latency. At peak, 67% of workflow jobs queued during that timeframe were impacted, and the median latency for impacted operations increased by up to 35x.This was caused by a significant change in load pattern on Actions Cache-related operations, leading to a saturated shared resource on the backend. The impact was mitigated by mitigating the new load pattern.To reduce the likelihood of a recurrence, we are improving rate-limiting measures in this area to ensure a more consistent experience for all customers. We are also evaluating changes to reduce the scope of impact.

1763575640

Investigating

We have applied mitigation and are seeing recovery

1763575166

Investigating

We are investigating delays in actions runs and possible errors in artifact and cache creation.

1763574976

Investigating

We are investigating reports of degraded performance for Actions

1763574497