Worldping alert execution delays

Incident Report for Grafana Cloud

Resolved

Engineers have deployed the permanent fix.

Posted Jun 03, 2019 - 21:03 UTC

Identified

Engineers have identified a software bug which is causing an intermittent delay updating check states in the backend database. The issue manifests after alert executors have been running for a long period of time. Engineers have restarted all alert executors to mitigate the issue while they work on a permanent fix.

Posted Jun 03, 2019 - 09:36 UTC

Investigating

Some users are reporting endpoint health being displayed as "No Data" intermittently. Engineers are investigating the issue.

Posted Jun 03, 2019 - 08:38 UTC