A node is fenced when an LVM-activate resource fails during OS shutdown in a Pacemaker cluster

Solution In Progress - Updated -

Issue

  • An ocf:heartbeat:LVM-activate resource fails to stop during an OS reboot or shutdown, causing the node to be fenced.

    Nov 24 17:47:25 fastvm-rhel-8-0-24 systemd[1]: Stopped Logout off all iSCSI sessions on shutdown.
    Nov 24 17:47:25 fastvm-rhel-8-0-24 LVM-activate(lvm)[1989]: ERROR:  Volume group "test_vg1" not found. Cannot process volume group test_vg1
    Nov 24 17:47:25 fastvm-rhel-8-0-24 LVM-activate(lvm)[1989]: ERROR: test_vg1: failed to deactivate.
    Nov 24 17:47:25 fastvm-rhel-8-0-24 pacemaker-execd[1875]: notice: lvm_stop_0[1989] error output [ ocf-exit-reason:test_vg1: failed to deactivate. ]
    Nov 24 17:47:25 fastvm-rhel-8-0-24 pacemaker-controld[1878]: notice: Result of stop operation for lvm on node2: error
    
  • An ocf:heartbeat:LVM resource stops successfully during an OS reboot or shutdown, but it logs a "volume group not found" error.

    Nov 28 00:30:34 fastvm-rhel-7-6-22 systemd: Stopped Logout off all iSCSI sessions on shutdown.
    Nov 28 00:30:39 fastvm-rhel-7-6-22 LVM(lvm)[3976]: INFO: Volume group test_vg1 not found
    Nov 28 00:30:39 fastvm-rhel-7-6-22 lrmd[2069]:  notice: lvm_stop_0:3976:stderr [   Volume group "test_vg1" not found ]
    Nov 28 00:30:39 fastvm-rhel-7-6-22 lrmd[2069]:  notice: lvm_stop_0:3976:stderr [   Cannot process volume group test_vg1 ]
    Nov 28 00:30:39 fastvm-rhel-7-6-22 crmd[2072]:  notice: Result of stop operation for lvm on node2: 0 (ok)
    
  • The shutdown-lock cluster property works fine when Pacemaker is stopped (e.g., with pcs cluster stop), but it fails when a node is rebooted or shut down.

Environment

  • Red Hat Enterprise Linux 7 (with the High Availability Add-on)
  • Red Hat Enterprise Linux 8 (with the High Availability Add-on)
  • May be more likely with LVM physical volumes presented via iSCSI

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content