Virtual Computing Lab (VCL) unavailable

Outage category: 
Applications
Location: 
All campuses
Status: 
Open
Resolved alert: 
01/20/2020 6:02 pm

All VCL services as described at https://its.gmu.edu/service/virtual-computing-lab/ and also the password reset function.

Initial symptoms: 

VCL systems unreachable.

Duration: 
01/20/2020 12:50 pm - 01/20/2020 6:02 pm
Impact to Mason: 

No VCL functionality

ROOT CAUSE ANALYSIS
Cause: 

Underlying storage system – NetApp – failed completely.

Resolution: 

NetApp storage system suffered complete failure, neither controller would boot into the operating system.

VCL functionality restored by switching to a Gluster based file system.

The switch to a new file system was already planned but NetApp failure prompted  the immediate reconfiguration

Prevention: 

Continue monitoring.

STATISTICS
Service Team: 
Cloud, Compute, and Storage Operations