Outage category: Applications
Location: All locations
Status: Open
Resolved Alert:
Initial Symptoms
No one could log into the Workflow application
Root Cause Analysis
Cause
Part of Banner Workflow application named “workflow engine” stayed as “offline” on workflow website even though the engine was started up on the Linux server. That affected workflow services and Mason’s travel system. Banner Workflow is running on Oracle WebLogic 12.2.1.3 with Java 1.8.0_231 Oracle security patches p28186730_139400_Generic and p29909359_139400_Generic were applied on March 29. Oracle changed security policy on newer Java version, which blocked RMI connection that Workflow needs.
Resolution
The issue has been fixed after the following Oracle WebLogic configuration parameters were changed:
-Dweblogic.oif.serialFilterMode=combine
-Dweblogic.oif.serialFilter=java.rmi.server.RemoteObject
Prevention
Working with vendor to determine how to prevent future issues.