Resolved
Due to a software bug the evaluation of some alert rules (primarily ones that have recovery threshold setting) were failing to be evaluated starting 14:00 UTC to 19:30 UTC today.
Posted Aug 08, 2026 - 19:48 UTC
This incident affected: Alerting and SLO (AWS Australia - prod-ap-southeast-2: Rule Evaluation, AWS Australia - prod-ap-southeast-2: Alertmanager and Rules Configuration API, AWS Australia - prod-ap-southeast-2: Alertmanager, AWS Brazil - prod-sa-east-1: Rule Evaluation, AWS Brazil - prod-sa-east-1: Alertmanager and Rules Configuration API, AWS Brazil - prod-sa-east-1: Alertmanager, AWS Canada - prod-ca-east-0: Rule Evaluation, AWS Canada - prod-ca-east-0: Alertmanager and Rules Configuration API, AWS Canada - prod-ca-east-0: Alertmanager, AWS Germany - prod-eu-west-2: Rule Evaluation, AWS Germany - prod-eu-west-2: Alertmanager and Rules Configuration API, AWS Germany - prod-eu-west-2: Alertmanager, AWS UAE - prod-me-central-1: Rule Evaluation, AWS UAE - prod-me-central-1: Alertmanager and Rules Configuration API, AWS UAE - prod-me-central-1: Alertmanager, AWS India - prod-ap-south-1: Rule Evaluation, AWS India - prod-ap-south-1: Alertmanager and Rules Configuration API, AWS Japan - prod-ap-northeast-0: Rule Evaluation, AWS Japan - prod-ap-northeast-0: Alertmanager and Rules Configuration API, AWS Singapore - prod-ap-southeast-1: Rule Evaluation, AWS Singapore - prod-ap-southeast-1: Alertmanager and Rules Configuration API, AWS Singapore - prod-ap-southeast-1: Alertmanager, AWS Sweden - prod-eu-north-0: Alertmanager and Rules Configuration API, AWS Sweden - prod-eu-north-0: Alertmanager, AWS Sweden - prod-eu-north-0: Rule Evaluation, AWS US East - prod-us-east-0: Rule Evaluation, AWS US East - prod-us-east-0: Alertmanager and Rules Configuration API, AWS US East - prod-us-east-0: Alertmanager, AWS US West - prod-us-west-0: Rule Evaluation, AWS US West - prod-us-west-0: Alertmanager and Rules Configuration API, AWS US West - prod-us-west-0: Alertmanager, AWS Ireland - prod-eu-west-6, AWS Switzerland - prod-eu-central-0, Azure Netherlands - prod-eu-west-3: Rule Evaluation, Azure Netherlands - prod-eu-west-3: Alertmanager and Rules Configuration API, Azure Netherlands - prod-eu-west-3: Alertmanager, Azure US Central - us-central2: Rule Evaluation, Azure US Central - us-central2: Alertmanager and Rules Configuration API, Azure US Central - us-central2: Alertmanager, GCP Australia - prod-au-southeast-0: Rule Evaluation, GCP Australia - prod-au-southeast-0: Alertmanager and Rules Configuration API, GCP Australia - prod-au-southeast-0: Alertmanager, GCP Belgium - prod-eu-west-0: Rule Evaluation, GCP Belgium - prod-eu-west-0: Alertmanager and Rules Configuration API, GCP Belgium - prod-eu-west-0: Alertmanager, GCP Brazil - prod-sa-east-0: Rule Evaluation, GCP Brazil - prod-sa-east-0: Alertmanager and Rules Configuration API, GCP Brazil - prod-sa-east-0: Alertmanager, GCP India - prod-ap-south-0: Rule Evaluation, GCP India - prod-ap-south-0: Alertmanager and Rules Configuration API, GCP India - prod-ap-south-0: Alertmanager, GCP Singapore - prod-ap-southeast-0: Rule Evaluation, GCP Singapore - prod-ap-southeast-0: Alertmanager and Rules Configuration API, GCP Singapore - prod-ap-southeast-0: Alertmanager, GCP UK - prod-gb-south-0: Rule Evaluation, GCP UK - prod-gb-south-0: Alertmanager and Rules Configuration API, GCP UK - prod-gb-south-0: Alertmanager, GCP US Central - prod-us-central-0: Rule Evaluation, GCP US Central - prod-us-central-0: Alertmanager and Rules Configuration API, GCP US Central - prod-us-central-0: Alertmanager, Federal Cloud - AWS US Gov West).