Deploys using Depot Builders failing
This issue has been resolved, deploys using Depot Builders are succeeding as expected.
Incident History
API errors
This incident has been resolved.
Machine creation errors in LHR
We observed several periods where Machine creations in LHR resulted in authentication errors from 11 Jan to 15 Jan 2025. Customers creating new Machines in the region may have seen failures with:
failed to launch VM: permission_denied: bolt token: failed to verify service token: no verified tokens; token : verify: context deadline exceeded
The disruptions were caused by degraded connectivity to our token creation service from three hosts.
We deployed a preventative fix for the network issues on 15 Jan 2025 at 12:58 UTC.
Timestamps of occurrences (UTC):
2025-01-11 03:32 to 2025-01-11 04:11 2025-01-11 17:07 to 2025-01-11 17:54 2025-01-14 11:36 to 2025-01-14 12:14 2025-01-15 07:46 to 2025-01-15 09:49
Bluegreen healthchecks not passing
This incident has been resolved.
Network issues in SJC region
This incident has been resolved.
Transient networking issue in FRA
This incident has been resolved.
IPv6 Networking Issue in SCL
This incident has been resolved.
Network Instability
This incident has been resolved.
Machine Creates and Updates currently failing
All changes have been deployed and Machine Create/Update API operations are healthy.
Networking issues in GDL
This incident has been resolved.