Below is the information we received from our database provider:
While performing work to complete a routine maintenance to provision additional capacity to the Object Rocket environment in [the datacenter], our internal networking team encountered a
VLAN configuration issue that resulted in a loss of connectivity to a number of customer
instances behind the affected router. A VLAN configuration was added that was not present on
the device. After confirming the VLAN was not required, our network engineer took action to
suspend the unnecessary port. While suspending the port, an unexpected behavior occurred on
the device and resulted in a suspension of all VLANS behind the device. The networking team
rolled back the change to stabilize the device, after which network traffic reconverged to
restore normal connectivity.
Posted Dec 29, 2014 - 13:23 EST
Resolved
Our data center has reported that all is back to normal. We were not affected past 10:31am ET. We will be updating this with the data center's root cause analysis about we receive it from them.
Posted Dec 17, 2014 - 11:20 EST
Monitoring
Our data center networking team informed us that they are investigating connectivity issues in our data center, which resulted in us having slower performance between 10:27am - 10:31am ET. During this time, some pages on our dashboard may have loaded slower than usual or API calls may have timed out. Since then, our monitoring has indicated all is well, though we are continuing to monitor the situation and are in close communication with our data center.