High number of 5XX on the Machines API and dashboard

Resolved

This incident has been resolved.

Update

We are still working on fixing degraded Managed Postgres clusters.

Update

Some Managed Postgres v1 clusters are degraded. We are working on fixing them. Managed Postgres v2 is unaffected.

Update

A fix has been implemented and we are monitoring the results.

Update

We've identified an internal service providing authentication to our Machines API has failed, our team is currently looking at our options for restoring this service. Existing Machines/Apps will continue to run as normal. Thank you for your patience.

Update

We've identified an internal service providing authentication to our Machines API has failed, our team is currently looking at our options for restoring this service. Existing Machines/Apps will continue to run as normal. Thank you for your patience.

Investigating

We are continuing to investigate this issue.

Investigating

Existing machines are unaffected. We are investigating the issue.