Information Technology Services

RAMP System Down

Outage category: Applications

Location: All RAMP Users

Status: Closed

Resolved Alert:

Initial Symptoms

No users were able to log into RAMP.

Root Cause Analysis

Cause

Huron and their partners, Amazon (AWS) and VMWare/Broadcom, determined there was an issue with AWS. Huron reported:
• AWS has been able to reproduce the issue
• The outage was related to an infrastructure change AWS applied
• This issue only impacted Huron
• The infrastructure change was rolled back which restored connectivity
• This change will not be reapplied until an approach is in place and tested to preclude loss of connection, and a mutually agreed time is scheduled between AWS and Huron

Resolution

Huron and their partners, Amazon (AWS) and VMWare/Broadcom, determined there was an issue with AWS. Huron reported:
• AWS has been able to reproduce the issue
• The outage was related to an infrastructure change AWS applied
• This issue only impacted Huron
• The infrastructure change was rolled back which restored connectivity
• This change will not be reapplied until an approach is in place and tested to preclude loss of connection, and a mutually agreed time is scheduled between AWS and Huron

Prevention

Huron and their partners, Amazon (AWS) and VMWare/Broadcom, determined there was an issue with AWS. Huron reported:
• AWS has been able to reproduce the issue
• The outage was related to an infrastructure change AWS applied
• This issue only impacted Huron
• The infrastructure change was rolled back which restored connectivity
• This change will not be reapplied until an approach is in place and tested to preclude loss of connection, and a mutually agreed time is scheduled between AWS and Huron