Outage report · Major outage

Kickserv outage on Nov 25, 2020

Infrastructure issues

SeverityMajor outage

StartedNov 25, 2020, 16:10UTC

ResolvedNov 26, 2020, 16:33UTC

Duration1d

What happened

Kickserv reported a major outage starting Nov 25, 2020, 16:10 UTC, affecting Web Application (app.kickserv.com), Customer Center, QuickBooks Online Sync, QuickBooks Desktop Sync, Email Notifications, Mobile API, Amazon Web Services, iOS App and 1 more. It was marked resolved at Nov 26, 2020, 16:33 UTC.

The incident lasted 1d from first report to resolution.
Kickserv had reported no other partial or major outages in the 90 days before it.
1 other vendor we track reported a significant incident within 12 hours of it.

Latest update from Kickserv

# Kickserv 11/25/20 Outage ## Summary On November 25, 2020, Amazon Web Services' Kinesis service suffered an extended outage, which impacted availability of Kickserv's server infrastructure \(along with many other applications on the Web\). During the outage, Kickserv engineers built and transitioned to a backup production web environment that did not depend on the affected services. Total Kickserv application downtime was approximately 2 hours 25 minutes. ## Situation \(all times EST\) **At 8:14 am**, Amazon's Kinesis service began experiencing an outage. However, since Amazon's [Service Health Dashboard]() also relies on Kinesis, most AWS tenants were unaware of the problem until later. **At 10:54 am**, Kickserv's alerting systems began indicating an application outage. Engineers discovered that Elastic Container Service \(ECS\) was affected, but Elastic Compute Cloud \(EC2\) was not. Over the next 2 hours, engineers built a new, temporary production web application environment

Read Kickserv's official incident report ↗