Observed write issues to Loki service

Incident Report for Grafana Cloud

Resolved

This incident has been resolved.

Posted Apr 20, 2022 - 16:09 UTC

Write and tail requests and are back to normal, but we are still monitoring the recovery of the cluster. Write latency is still increased.

Posted Apr 20, 2022 - 15:17 UTC

A fix has been implemented and we are monitoring the results.

Posted Apr 20, 2022 - 15:08 UTC

We are currently investigating an issue with ingesters that can cause log writes to, and log tailing from, hosted Loki instances to fail.

Posted Apr 20, 2022 - 13:32 UTC

This incident affected: Logs (GCP US Central - prod-us-central-0).