Issues with Websites and Mail DeliveryMay 06, 2019 1:38 p.m.
DNS records pointing to F5 load-balancer were not resolving.
Customers could not reach specific websites that were hosted on the server Jiju.
Websites were not available. Customers were getting page not found errors as IP addresses were not resolving to DNS names.
Multiple DNS records were inadvertently removed from the IPControl system which resulted in unresolved ip addresses. This occurred when doing cleanup of old, unneeded records.
DNS records were added back into the system.
This occurred when doing cleanup of old, unneeded records. Going forward recommend doing a DNS push immediately following any submit. In this case, submit was done without an associated push so problem didn’t occur until an unrelated push was done. Also recommend that any DNS record delete be done as part of an RFC.