As of 15:25 UTC, Engineering applied remediation and we are observing nominal behavior. Users should be able to access their instance login pages as expected. We are considering this issue resolved.
No further updates.
Posted Jun 29, 2023 - 15:35 UTC
Update
We are continuing to investigate this issue.
Posted Jun 29, 2023 - 11:48 UTC
Investigating
We are currently experiencing some issues with a plugin reconciliation that's causing an increased load on our servers. The reconciliation is now paused as we work on remediating this issue. Majority of our services remain operational. However, few users may encounter longer loading times.
Posted Jun 29, 2023 - 09:46 UTC
This incident affected: Grafana (AWS Canada - prod-ca-east-0, AWS Germany - prod-eu-west-2, AWS Germany - prod-eu-west-4, AWS Singapore - prod-ap-southeast-1, AWS US East (OH) - prod-us-east-0, AWS US East (OH) - prod-us-east-2, Azure US Central - us-central2, Azure Netherlands - prod-eu-west-3, GCP Australia - prod-au-southeast-0, GCP Belgium - prod-eu-west-0, GCP Brazil - prod-sa-east-0, GCP India - prod-ap-south-0, GCP Singapore - prod-ap-southeast-0, GCP UK - prod-gb-south-0, GCP US Central - prod-us-central-0, GCP US Central - prod-us-central-3, GCP US Central - prod-us-central-4, GCP US East - prod-us-east-1).