This morning an outage occurred with RedEyeDMS.
Outage date: Friday 27 October 2017
Total outage time: 26 minutes (09:40am AEST – 10:06am AEST)
Outage status: Normal service has been restored
RedEye experienced diminished performance for a brief period, affecting all users. The root cause of the event has been identified and subsequent mitigation plans have been implemented to prevent the issue from reoccurring.
There has been no impact to the integrity of information and data in the system.
We are sorry for any impact you experienced during the outage, and thank you for your understanding.
If you have any further queries or concerns please contact your Customer Success Manager.
The primary database suffered from storage performance degradation due to a problem with the AWS RDS service. The servers experienced slower than guaranteed disk access (IOPS) that reduced the performance for all connections to the database.
Once diagnosed to ensure that the fault was not application related, a restart of the primary MySQL database resolved the issue.
Over the weekend, the RedEyeDMS team will modify the database cluster and replicas to increase the allocated disk performance to further reduce latency on requests.