Outage report · Major outage

Upstash outage on Jun 11, 2025

Degraded Performance

SeverityMajor outage

StartedJun 11, 2025, 06:51UTC

ResolvedJun 11, 2025, 10:02UTC

Duration3h 11m

What happened

Upstash reported a major outage starting Jun 11, 2025, 06:51 UTC, affecting N. Virginia, USA (us-east-1), N. California, USA (us-west-1), Oregon, USA (us-west-2), Frankfurt, Germany (eu-central-1), Ireland (eu-west-1), Singapore (ap-southeast-1), Sydney, Australia (ap-southeast-2), Mumbai, India (ap-south-1) and 4 more. It was marked resolved at Jun 11, 2025, 10:02 UTC.

The incident lasted 3h 11m from first report to resolution.
Upstash had reported no other partial or major outages in the 90 days before it.
4 other vendors we track reported a significant incident within 12 hours of it.

Latest update from Upstash

A routine system maintenance operation at the OS level led to the application of system updates across multiple EC2 instances in our clusters in several AWS regions. These updates included changes to networking components, which inadvertently triggered restarts. As a result, several EC2 nodes failed health checks and temporarily dropped out of the cluster, disrupting high availability and causing partial connectivity issues for some clients and operations. We have since reproduced the issue in a controlled environment and verified the root cause. To prevent a recurrence, we are updating our node maintenance strategy to ensure greater control over the timing and impact of system-level changes and excluding networking components from automated upgrades.

Read Upstash's official incident report ↗