clvmd fails to start with "Unable to create DLM lockspace for CLVM: Transport endpoint is not connected' in RHEL 5 or 6

Solution Unverified - Updated -

Issue

  • After reboot, none of the nodes will mount the SAN gfs2 file systems. Need to restore entries in /dev for the file systems.
  • Even though I started clvmd, logical volumes are not found in /dev and I can't mount GFS2 file systems
  • When I start clvmd I see "Transport endpoint is not connected"
Jan 25 18:21:32 node1 kernel: dlm: no local IP address has been set
Jan 25 18:21:32 node1 kernel: dlm: cannot start dlm lowcomms -107
Jan 25 18:21:32 node1 clvmd: Unable to create DLM lockspace for CLVM: Transport endpoint is not connected
  • When attempting to join a cluster, my node prints a long string of "Cluster is not quorate" messages for several minutes and then fails to start clvmd
Jan 25 18:16:29 node1 ccsd[8922]: Cluster is not quorate.  Refusing connection.
Jan 25 18:16:29 node1 ccsd[8922]: Error while processing connect: Connection refused 
Jan 25 18:16:30 node1 ccsd[8922]: Cluster is not quorate.  Refusing connection.
Jan 25 18:16:30 node1 ccsd[8922]: Error while processing connect: Connection refused 
Jan 25 18:16:30 node1 ccsd[8922]: Cluster is not quorate.  Refusing connection.
  • The clvmd daemon failed to start during reboot of entire cluster.

Environment

  • Red Hat Enterprise Linux (RHEL) 5 or 6 with the Resilient Storage Add On
  • lvm2-cluster
    • locking_type = 3 in /etc/lvm/lvm.conf
    • One or more volume group with the clustered attribute set
  • Cluster with more than 2 votes, either by having more than 2 nodes or having 2 nodes plus a quorum device

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content