Loki error response rate spike on prod-ap-southeast-1

Resolved

This incident has been resolved.

Update

We have deployed temporary measures to mitigate the issue, but there was a writes outage from  06:26 to 06:37 UTC.

Investigating

cloud logging is facing write issues in this region, our team is looking into this.