Stonith device fails with "USB disconnect" and "New USB device found" logs
Issue
A stonith device's monitor and start operation timed out with USB related logs as below.
Nov 11 16:15:54 node1 kernel: usb 1-1: USB disconnect, device number 2
Nov 11 16:16:02 node1 kernel: usb 1-1: new high-speed USB device number 3 using xhci_hcd
Nov 11 16:16:02 node1 kernel: usb 1-1: New USB device found, idVendor=2a4b, idProduct=0400, bcdDevice= 1.00
Nov 11 16:16:02 node1 kernel: usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Nov 11 16:16:02 node1 kernel: usb 1-1: Product: Emulex Pilot4 HighSpeed HUB
Nov 11 16:16:02 node1 kernel: usb 1-1: Manufacturer: Emulex Communications
Nov 11 16:16:02 node1 kernel: usb 1-1: SerialNumber: 0xBABEFACE
Nov 11 16:16:02 node1 kernel: hub 1-1:1.0: USB hub found
Nov 11 16:16:02 node1 kernel: hub 1-1:1.0: 7 ports detected
Nov 11 16:16:13 node1 pacemaker-fenced[4192]: warning: fence_ipmilan_monitor_1 process (PID 3304356) timed out
Nov 11 16:16:13 node1 pacemaker-fenced[4192]: warning: fence_ipmilan_monitor_1:3304356 - timed out after 20000ms
Nov 11 16:16:13 node1 pacemaker-fenced[4192]: notice: Operation 'monitor' [3304356] for device 'fence01' returned: -62 (Timer expired)
Nov 11 16:16:13 node1 pacemaker-controld[4196]: error: Result of monitor operation for fence01 on node1: Timed Out
Nov 11 16:16:13 node1 pacemaker-attrd[4194]: notice: Setting fail-count-fence01#monitor_30000[node1]: (unset) -> 1
Nov 11 16:16:13 node1 pacemaker-attrd[4194]: notice: Setting last-failure-fence01#monitor_30000[node1]: (unset) -> 1636701373
Nov 11 16:16:13 node1 pacemaker-controld[4196]: notice: Result of stop operation for fence01 on node1: 0 (ok)
Nov 11 16:16:23 node1 kernel: usb 1-1.1: new high-speed USB device number 4 using xhci_hcd
Nov 11 16:16:23 node1 kernel: usb 1-1.1: New USB device found, idVendor=17ef, idProduct=b000, bcdDevice= 0.00
Nov 11 16:16:23 node1 kernel: usb 1-1.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
Nov 11 16:16:23 node1 kernel: usb 1-1.1: Product: Keyboard/Mouse Function
Nov 11 16:16:23 node1 kernel: usb 1-1.1: Manufacturer: Avocent
Nov 11 16:16:23 node1 kernel: usb 1-1.1: SerialNumber: 20200430
Nov 11 16:16:23 node1 kernel: input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:14.0/usb1/1-1/1-1.1/1-1.1:1.0/0003:17EF:B000.0001/input/input2
Nov 11 16:16:23 node1 kernel: hid-generic 0003:17EF:B000.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:14.0-1.1/input0
Nov 11 16:16:23 node1 kernel: input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:14.0/usb1/1-1/1-1.1/1-1.1:1.1/0003:17EF:B000.0002/input/input3
Nov 11 16:16:23 node1 kernel: hid-generic 0003:17EF:B000.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:14.0-1.1/input1
Nov 11 16:16:23 node1 kernel: input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:14.0/usb1/1-1/1-1.1/1-1.1:1.2/0003:17EF:B000.0003/input/input4
Nov 11 16:16:23 node1 kernel: hid-generic 0003:17EF:B000.0003: input,hidraw2: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:14.0-1.1/input2
Nov 11 16:16:24 node1 systemd-logind[2504]: Watching system buttons on /dev/input/event2 (Avocent Keyboard/Mouse Function)
Nov 11 16:16:33 node1 pacemaker-fenced[4192]: warning: fence_ipmilan_monitor_1 process (PID 3304603) timed out
Nov 11 16:16:33 node1 pacemaker-fenced[4192]: warning: fence_ipmilan_monitor_1:3304603 - timed out after 20000ms
Nov 11 16:16:33 node1 pacemaker-fenced[4192]: notice: Operation 'monitor' [3304603] for device 'fence01' returned: -62 (Timer expired)
Nov 11 16:16:33 node1 pacemaker-controld[4196]: error: Result of start operation for fence01 on node1: Timed Out
Nov 11 16:16:33 node1 pacemaker-attrd[4194]: notice: Setting fail-count-fence01#start_0[node1]: (unset) -> INFINITY
Nov 11 16:16:33 node1 pacemaker-attrd[4194]: notice: Setting last-failure-fence01#start_0[node1]: (unset) -> 1636701393
Nov 11 16:16:33 node1 pacemaker-controld[4196]: notice: Result of stop operation for fence01 on node1: 0 (ok)
Nov 11 16:16:53 node1 pacemaker-attrd[4194]: notice: Setting fail-count-fence01#start_0[node2]: (unset) -> INFINITY
Nov 11 16:16:53 node1 pacemaker-attrd[4194]: notice: Setting last-failure-fence01#start_0[node2]: (unset) -> 1636701413
Nov 11 16:17:30 node1 kernel: power_meter ACPI000D:00: Found ACPI power meter.
Nov 11 16:17:30 node1 kernel: power_meter ACPI000D:00: Ignoring unsafe software power cap!
Nov 11 16:17:45 node1 kernel: usb 1-1.1: USB disconnect, device number 4
Environment
- Red Hat Enterprise Linux 8 (with the High Availability Add On)
- Lenovo ThinkSystem SR650
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.