We continue to observe instances initializing as expected. We are considering this incident resolved at this time.
No further updates.
Posted Jun 29, 2023 - 19:38 UTC
Monitoring
As of 16:28 UTC, Engineering has applied a mitigation and we are seeing instances initialize as expected. We will continue to monitor for a 30 minute period to ensure expected behavior continues.
Posted Jun 29, 2023 - 18:32 UTC
Investigating
As of 17:30 UTC, we have been alerted to multiple Cloud instances that are failing to initialize or are taking longer than anticipated to initialize across all clusters. Engineering is aware and actively investigating. We will provide updates as more information is shared.
Posted Jun 29, 2023 - 17:57 UTC
This incident affected: Grafana (AWS Canada - prod-ca-east-0, AWS Germany - prod-eu-west-2, AWS Germany - prod-eu-west-4, AWS Singapore - prod-ap-southeast-1, AWS US East (OH) - prod-us-east-0, AWS US East (OH) - prod-us-east-2, Azure US Central - us-central2, Azure Netherlands - prod-eu-west-3, GCP Australia - prod-au-southeast-0, GCP Belgium - prod-eu-west-0, GCP Brazil - prod-sa-east-0, GCP India - prod-ap-south-0, GCP Singapore - prod-ap-southeast-0, GCP UK - prod-gb-south-0, GCP US Central - prod-us-central-0, GCP US Central - prod-us-central-3, GCP US Central - prod-us-central-4, GCP US East - prod-us-east-1, play.grafana.org).