Virtual Computing Lab Reservations Do Not Complete

May 14, 2019 9:09 a.m.
Outage category: 
Applications
Location: 
VCL Systems for all campuses
Status: 
Closed
Resolved alert: 
05/06/2019 9:45 am

The vclhelp email account and support center received a few calls from students stating that their reservations were not finishing.

Initial symptoms: 

Virtual machines were not available to users as system was not completing the reservations made.

Duration: 
05/05/2019 10:00 pm - 05/06/2019 9:45 am
Impact to Mason: 

Virtual Computing Lab was unavailable.

ROOT CAUSE ANALYSIS
Cause: 

The OpenNebula controller failed which controls the actual virtual machines. This was complicated by another system that would normally automate the restart of the OpenNebula controller also failing

Resolution: 

Both the OpenNebula controller and the automation server were restarted and all servers returned to operation.

Prevention: 

The root cause of the initial problem is unknown. This scenario is highly unlikely to reoccur.

STATISTICS
Service Team: 
Computing Services