Increased app-not-found errors

Resolved

This incident has been resolved.

Update

A fix has been implemented and we are monitoring the results

Update

We’ve deployed an additional mitigation to further reduce Corrosion retry pressure and are seeing improvement; we’re continuing to monitor while remaining affected nodes catch up.

Update

We’ve applied a mitigation to reduce the impact from Corrosion batch insertion retries and are continuing to monitor while affected nodes catch up.

Update

We have identified the issue as failed insertions in a subset of Corrosion batches. These failures trigger retries, which can cause timeouts for other batches.

Investigating

We are currently investigating app-not-found errors returned by Machines API calls made shortly after creating new applications.