Inconsistent threshold check results reported intermittently

Resolved

This incident has been resolved.

Update

The issue causing the incident has been identified, and the fix has been deployed. All new test runs work consistently

Update

We are continuing to work on a fix for this issue.

Update

We encountered a subtle bug which caused our test-run finalization process to read from stale threshold status because of a synchronization issue.

We have since resolved the bug, and new test runs will work properly. Impacted test runs will need to be fixed via further correction on our end. We will continue to provide updates on the progress of the fix for impacted test runs.