Samba CTDB resource unable to start and timeout errors logged when booting multiple nodes at the same time in a RHEL 7 High Availability cluster

Solution Unverified - Updated -

Issue

  • When rebooting 2 cluster nodes at same time, it fails to stat Samba service on server boot up.
  • CTDB seems to timeout on start when the entire cluster is starting at once
Jan 14 20:12:35 node2  crmd[5420]: notice: te_rsc_command: Initiating action 57: start Samba_CTDB_start_0 on node1.example.com
Jan 14 20:12:56 node2  CTDB(Samba_CTDB)[9550]: ERROR: CTDB status call failed: 2015/01/14 20:12:56.845750 [ 9554]: client/ctdb_client.c:267 Failed to connect client socket to daemon. Errno:No such file or directory(2)
common/cmdline.c:156 Failed to connect to daemon
2015/01/14 20:12:56.845826 [ 9554]: Failed to init ctdb
Jan 14 20:12:57 node2  CTDB(Samba_CTDB)[9550]: INFO: Generating new /etc/sysconfig/ctdb
Jan 14 20:14:26 node2  lrmd[5417]: warning: child_timeout_callback: Samba_CTDB_start_0 process (PID 9550) timed out
Jan 14 20:14:26 node2  lrmd[5417]: warning: operation_finished: Samba_CTDB_start_0:9550 - timed out after 90000ms
Jan 14 20:14:26 node2  crmd[5420]: error: process_lrm_event: LRM operation Samba_CTDB_start_0 (72) Timed Out (timeout=90000ms)
Jan 14 20:14:26 node2  crmd[5420]: warning: status_from_rc: Action 59 (Samba_CTDB_start_0) on node2 .mboi.in failed (target: 0 vs. rc: 1): Error
Jan 14 20:14:26 node2  crmd[5420]: warning: update_failcount: Updating failcount for Samba_CTDB on node2 .mboi.in after failed start: rc=1 (update=INFINITY, time=1421246666)
Jan 14 20:14:26 node2  crmd[5420]: warning: update_failcount: Updating failcount for Samba_CTDB on node2 .mboi.in after failed start: rc=1 (update=INFINITY, time=1421246666)
Jan 14 20:14:26 node2  attrd[5418]: notice: attrd_trigger_update: Sending flush op to all hosts for: fail-count-Samba_CTDB (INFINITY)

Environment

  • Red Hat Enterprise Linux (RHEL) 7 with the High Availability Add On
  • pacemaker
  • One or more CTDB clone resources in the cluster CIB

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content