Resolved -
Spanning from November 10th, 18:00 UTC to November 11th, 22:00 UTC, Synthetic Monitoring experienced degraded browser check performance due to a faulty release that has been rolled back.
This impacted all regions, specifically the probes. The API itself experienced no issues.
Nov 12, 16:50 UTC
Resolved -
This incident has been resolved.
Nov 5, 14:33 UTC
Monitoring -
The services are recovering and we can confirm that majority of the tests were not impacted.
Nov 5, 10:56 UTC
Update -
We are continuing to investigate this issue.
Nov 5, 09:40 UTC
Investigating -
We are currently investigating multiple issues impacting Grafana k6 tests: - Metrics for new and running test runs arriving late. - New test runs could be getting aborted by system or timed out. - Result Analysis page may not show any metrics. - Requests could be timing out throughout GCk6 Plugin.
Nov 5, 08:30 UTC
Resolved -
Test runs are now working as expected. The duration of this incident was roughly 30 minutes. The test runs were not able to start, and the app and the API were not accessible.
Nov 4, 19:27 UTC
Investigating -
We are currently investigating an issue impacting Grafana K6 which is resulting in tests being unable to start. All cloud test runs are affected. Cloud output test runs seem to be operational.
Nov 4, 19:00 UTC
Resolved -
From Oct 31st 17:40 UTC to Nov 3rd 14:50 UTC:
Due to some internal auth issues, the components evaluating loki-managed rules failed to push the evaluated recording and alert rules to the metrics endpoint for some tenants.
Nov 3, 15:04 UTC
Resolved -
This incident has been resolved.
Nov 3, 14:13 UTC
Monitoring -
A fix has been implemented and we can see the system are recovering everywhere. We're monitoring the situation.
Nov 3, 12:28 UTC
Investigating -
We became aware of an issue with the services in prod-us-central-7. Users experiencing this issue may encounter issues sending data to Grafana Cloud.