Investigating major connectivity issues

Incident Report for Braze, Inc.

Resolved

This incident has been resolved.
Posted Aug 02, 2017 - 20:38 EDT

Update

All services are operating as expected. Some data processing is slightly delayed and will catch up in the next few minutes. We are continuing to monitor for connectivity issues.
Posted Aug 02, 2017 - 20:30 EDT

Monitoring

All services are returning to normal. We are scaling up additional servers in the unaffected availability zones in order to handle the increased traffic.
Posted Aug 02, 2017 - 20:28 EDT

Update

We have completed dashboard failover, and APIs remain online. Message sending and data processing that were in the affected region remain delayed, but data processing and message sending are returning to normal in unaffected availability zones.
Posted Aug 02, 2017 - 20:20 EDT

Identified

We have failed over some services. APIs are taking traffic again, message sending and message processing are heavily delayed as we are keeping many processes paused until failover is complete.
Posted Aug 02, 2017 - 20:07 EDT

Update

We are working to fail over all services dependent on the affected AWS availability zone.
Posted Aug 02, 2017 - 19:53 EDT

Update

The issue is caused by AWS Network Connectivity issues in the US-EAST-1 region. Status for AWS is available at https://status.aws.amazon.com/. Our team is continuing to identify steps for resolution.
Posted Aug 02, 2017 - 19:46 EDT

Investigating

We are currently investigating major connectivity issues in our US-EAST regions.
Posted Aug 02, 2017 - 19:41 EDT