Outage category: Webex
Location: Online - videoconferencing endpoints.
Status: Closed
Resolved Alert:
Initial Symptoms
Audio and video quality was impacted causing baps in both during meetings and during recordings.
Root Cause Analysis
Cause
The cause of the service outage was determined to be filesystem related error. It appears we were experiencing a tremendous amount of attempts in the same way that was blocking and this flooded a single CPU (instead of the load being balanced between them via round robin or some other method). Multicast traffic was causing this activity.
Resolution
The source of the multicast traffic was found and turned off, resulting in a clearing of the issue.
Prevention
Network & Security Engineering is working with the vendor to determine why this caused and error and how to prevent such errors in the future.