Grafana Cloud: Prometheus increased series generation due to Tempo update
Incident Report for Grafana Cloud
Resolved
This incident has been resolved.
Posted May 23, 2023 - 08:51 UTC
Update
This issue has been resolved and we are currently monitoring.
Posted May 22, 2023 - 21:42 UTC
Monitoring
During a weekly update cycle, we implemented a modification to the Tempo system that inadvertently led to a significant increase in the number of series being produced by the Metrics Generator. This issue affected multiple regions for a duration of 6-11 hours. We have since identified the root cause and have deployed a fix to address it.
Posted May 22, 2023 - 10:00 UTC
This incident affected: Grafana Cloud: Prometheus (US-CENTRAL: Querying, US-CENTRAL: Ingestion, EU-WEST: Querying, EU-WEST: Ingestion, AZURE - Querying, AZURE - Ingestion, UK-SOUTH: Querying, UK-SOUTH: Ingestion, AU Southeast Querying, AU Southeast Ingestion, AWS US-East Querying, AWS US-East Ingestion).
← Current Status Powered by Atlassian Statuspage