Start time: 2019-10-08 12:10

Got notified: 2019-10-08 12:15

Resolution time: 2019-10-08 12:51

Problem:

Happeo was inaccessible from web and mobile. All APIs were down.

Affected:

All customers, all users.

Root cause:

Google Appengine and Cloud Functions were down in Europe West 1. GCP Appengine in EU West 1 is our main computing platform and if it is down, our application is down.

We don’t have backup servers in other regions because, in Appengine Standard, it is not possible.

Actions taken:

• Investigated but saw no root cause
• Saw from [https://status.cloud.google.com/](https://status.cloud.google.com) that Google is having an outage
• Communicated to customer success
• Contacted Google Support, informed us to wait
• Waited for Google to resolve the issue