As of 16:15 UTC, Engineering has completed release efforts and the correction is now available for the Loki querier. Users should now be able to query logs with accurate results. As such, we are considering this issue resolved.
No further updates.
Posted Jun 10, 2023 - 16:18 UTC
Identified
As of 15:20 UTC, Engineering has identified the issue and has begun implementing a correction for the Loki querier. We will monitor the results and provide updates as information is shared.
Posted Jun 10, 2023 - 15:48 UTC
Investigating
We have identified an issue in the most recent release of Loki that manifests in the querying of logs, only. Log queries may return incorrect results, with fewer than anticipated logs. This issue does not impact log ingestion or the storage of logs in any capacity. Engineering is aware and actively working to remediate.
We will monitor and provide updates as information is shared.
Posted Jun 10, 2023 - 14:32 UTC
This incident affected: Logs (AWS US East (OH) - prod-us-east-0, Azure US Central - us-central2, GCP Belgium - prod-eu-west-0, GCP Singapore - prod-ap-southeast-0, GCP UK - prod-gb-south-0, GCP US Central - prod-us-central-0).