Users called into Support Center that Blackboard was unavailable

All users affected. MyMason/Blackboard site was unavailable.

Blackboard engineers were performing an internal development site resource cleanup and during this process the Learn security groups were deleted. The missing security group caused a break in the database which led to an outage for Learn production sites.

Blackboard patched the security rules as a workaround and the sites started to recover. Blackboard immediately corrected the issue and redeployed, which fixed the issue permanently.

Blackboard engineers will further audit similar imported resources. The engineers will inspect the security groups in use and validate that Learn-related security groups are not being used by any microservices.