Issues with metered billing report generation

Resolved

This incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be shared as soon as it is available.

Update

The degradation has been mitigated. We are monitoring to ensure stability.

Investigating

We have applied mitigations to a data store related to billing reports, and are seeing partial recovery to billing report generation. We continue to monitor for full recovery.

Investigating

We are seeing a high number of 500s due to timeouts across GitHub services. We are redeploying some of our core services and we expect that this allow us to recover.

Investigating

We're continuing to see high failure rates on billing report generation, and are working on mitigations for a data store related to billing reports.

Investigating

We're seeing issues related to metered billing reports, intermittently affecting metered usage graphs and reports on the billing page. We have identified an issue with a data store, and are working on mitigations.

Investigating

We are investigating reports of impacted performance for some GitHub services.