Network Outage – Science & Tech Campus – Multiple Locations

Outage category: 
VoIP phone service, Wired Network, Wireless Network
Location: 
Science & Tech Campus: Bull Run Hall, Discovery Hall, Hylton Performing Arts, and Bio-Research lab.
Status: 
Closed
Resolved alert: 
05/01/2019 10:30 am

Hylton Performing Arts, Bull Run, Discovery, and Bio-Research Lab buildings had no Voice over IP or Internet services.

Initial symptoms: 

Users in the listed buildings reported a loss of internet connectivity.

Duration: 
05/01/2019 8:49 am - 05/01/2019 10:30 am
Impact to Mason: 

The listing buildings had no Vioce over IP, Wired, or Wireless services.

Affected Services: 
Telephone & Voice Mail Services, Network Access
ROOT CAUSE ANALYSIS
Cause: 

Engineers went to IACR and noticed that the first PE in the VSS had zero active connections and 90% of the connections second PE were also down.

Resolution: 

Engineers rebooted the router once rebooted VSS started passing traffic between the Router and all internet Services was restored.

Prevention: 

Network & security engineering is working with the vendor to determine cause and prevention of future reoccurance.

STATISTICS
Service Team: 
Network & Security Engineering