Skip to navigation

"[TOTEM] Retransmit List" messages repeatedly seen in RHEL 5 or 6 cluster node logs

Updated 2014-04-18T19:56:49+00:00

Issue

  • There are lots of repeating messages written to /var/log/messages similar to the following below on Red hat Enterprise Linux 5 cluster nodes:
Jul 25 04:20:16 node1 openais[18311]: [TOTEM] Retransmit List: 6053c6  
Jul 25 04:20:16 node1 openais[18311]: [TOTEM] Retransmit List: 6053d0  
  • There are lots of repeating messages written to /var/log/messages similar to the following below on Red Hat Enterprise Linux 6 cluster nodes:
Sep 22 12:37:45 node1 corosync [TOTEM] Retransmit List: 31 
Sep 22 12:37:46 node1 corosync [TOTEM] Retransmit List 1
  • RHEL nodes fails to join the cluster with "Retransmit List" errors in logs.
  • clvmd hangs and lvm commands like lvs, lvdisplay, etc do not respond after seeing repeating "Retransmit List" messages in the logs
  • rgmanager or clusvcadm operations do not complete when there are retransmits in /var/log/messages

Environment

  • Red Hat Enterprise Linux 5 (RHEL5) Advanced Platform, High Availability or Resilient Storage Add-on (Clustering) using the openais package for cluster communication
  • Red Hat Enterprise Linux 6 (RHEL6) with High Availability or Resilient Storage Add-on using the corosync package for cluster communication

Subscriber content preview. For full access to the Red Hat Knowledgebase, please log in.

Not a subscriber? Learn more about the benefits of Red Hat Subscriptions.