Isolated Codespaces creation failures in the West Europe region


Incident resolved in 6h30m8s

Resolved

This incident has been resolved.

1728430374

Investigating

Codespaces is operating normally.

1728430371

Investigating

Codespace creation has been remediated in this region.

1728430347

Investigating

We are once again seeing signs of increased latency for codespace creation in this region, but are at the same time recovering previously unavailable resources.

1728428056

Investigating

Recovery continues slowly, and we are investigating strategies to speed up the recovery process.

1728425451

Investigating

We are continuing to see gradual recovery in the region and continue to validate the persistent fix.

1728423547

Investigating

The persistent fix has been applied, and are beginning to see improvements in the region. We are still working on follow-on effects, however, and expect recovery to be gradual.

1728421599

Investigating

We are nearing full application of the persistent fix and will provide more updates soon.

1728419209

Investigating

Mitigations we have put in place are yielding improvements in Codespace creation success rates in the affected region. We expect full recovery once the persistent fix fully rolls out.

1728417103

Investigating

We are continuing to work on mitigations while the more persistent fix rolls out.

1728415053

Investigating

We are continuing to apply mitigations while we deploy the more persistent fix. Full recovery is expected in 2 hours or less, but more updates will be coming soon.

1728413093

Investigating

We have applied some mitigations that are improving creation success rates while we work on the more comprehensive fix.

1728410904

Investigating

We have identified a possible root cause and are working on the fix.

1728409394

Investigating

Some Codespaces are failing to create successfully in the Western EU region. Investigating is ongoing.

1728407481

Investigating

Codespaces is experiencing degraded performance. We are continuing to investigate.

1728407302

Investigating

We are currently investigating this issue.

1728406966