HCP Terraform Latency Degredation

Resolved

The applied mitigations have successfully resolved the issue.

During the incident customers may have noticed Terraform Runs failing due to the increased latency: those can now be retried.

Update

Engineers have rolled back the problematic change, and have observed signs of recovery. We are currently monitoring the application to ensure a return to normal operation.

Update

Our Engineering team has identified and is currently attempting to mitigate a change that has increased latency on HCP Terraform. Customers are likely experiencing large increases in latency across Workspace and Run api endpoints.