RHEL 6 High Availability or Resilient Storage cluster shows non-existent estranged nodes in clustat output, or has "Received message has invalid digest... ignoring. " messages in logs
Issue
- Cluster node flooded with the following messages in
/var/log/messages:
Jan 24 04:08:25 node1 openais[743]: [MAIN ] Invalid packet data
Jan 24 04:08:25 node1 openais[743]: [MAIN ] Received message has invalid digest... ignoring.
Jan 24 04:08:25 node1 openais[743]: [MAIN ] Invalid packet data
Jan 24 04:08:26 node1 openais[743]: [MAIN ] Received message has invalid digest... ignoring.
- Clustat output shows estranged nodes in the node list that aren't a part of the cluster:
Cluster Status for test-cluster @ Wed Oct 7 10:18:38 2009
Member Status: Quorate
Member Name ID Status
------ ---- ---- ------
node1.test 2 Online, Local
node2.test 1 Online
node7.prod 7 Offline, Estranged
- Cluster showing odd behavior such as pulling the wrong configuration, or configuration version number when using cman_tool or other synchronization mechanism:
Environment
- Red Hat Enterprise Linux Server 5 (with the High Availability Add on)
- Red Hat Enterprise Linux Server 6 (with the High Availability Add on)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
