Unable to start gluster daemon after failover in Red Hat Gluster Storage 3.0 ?
Issue
-
Problem with starting gluster daemon after failover
-
Glusterd service was unable to start on one node after testing disaster recovery
~Snippet from cli logs,
[2015-06-02 19:00:02.610533] T [cli.c:264:cli_rpc_notify] 0-glusterfs: got RPC_CLNT_CONNECT
[2015-06-02 19:00:02.610599] W [socket.c:530:__socket_rwv] 0-glusterfs: readv on /var/run/glusterd.socket failed (Invalid argument)
[2015-06-02 19:00:02.610628] T [rpc-clnt.c:1381:rpc_clnt_record] 0-glusterfs: Auth Info: pid: 0, uid: 0, gid: 0, owner:
[2015-06-02 19:00:02.610655] D [socket.c:2263:socket_event_handler] 0-transport: disconnecting now
[2015-06-02 19:00:02.610704] T [rpc-clnt.c:1238:rpc_clnt_record_build_header] 0-rpc-clnt: Request fraglen 72, payload: 8, rpc hdr: 64
[2015-06-02 19:00:02.610726] T [socket.c:2740:socket_connect] 0-glusterfs: connecting 0xa96c00, state=0 gen=0 sock=-1
[2015-06-02 19:00:02.610760] T [name.c:290:af_unix_client_get_remote_sockaddr] 0-glusterfs: using connect-path /var/run/glusterd.socket
[2015-06-02 19:00:02.610812] T [name.c:106:af_unix_client_bind] 0-glusterfs: bind-path not specified for unix socket, letting connect to assign default value
[2015-06-02 19:00:02.610856] D [socket.c:2869:socket_connect] 0-glusterfs: connection attempt on /var/run/glusterd.socket failed, (Connection refused)
[2015-06-02 19:00:02.610877] I [socket.c:3149:socket_submit_request] 0-glusterfs: not connected (priv->connected = 0)
[2015-06-02 19:00:02.610884] W [rpc-clnt.c:1562:rpc_clnt_submit] 0-glusterfs: failed to submit rpc-request (XID: 0x1 Program: Gluster CLI, ProgVers: 2, Proc: 3) to rpc-transport (glusterfs)
[2015-06-02 19:00:02.610925] T [cli.c:270:cli_rpc_notify] 0-glusterfs: got RPC_CLNT_DISCONNECT
~Snippet from glusterd log,
[2015-06-02 19:00:11.734467] I [glusterd-handler.c:3185:glusterd_friend_add] 0-management: connect returned 0
[2015-06-02 19:00:11.735228] D [store.c:418:gf_store_handle_new] 0-: Returning 0
[2015-06-02 19:00:11.735240] D [store.c:437:gf_store_handle_retrieve] 0-: Returning 0
[2015-06-02 19:00:11.735248] D [store.c:499:gf_store_iter_new] 0-: Returning with 0
[2015-06-02 19:00:11.735258] D [store.c:608:gf_store_iter_get_next] 0-: Returning with -1
[2015-06-02 19:00:11.735265] D [glusterd-store.c:4093:glusterd_store_retrieve_peers] 0-: Returning with -1
[2015-06-02 19:00:11.735270] D [glusterd-store.c:4308:glusterd_restore] 0-: Returning -1
[2015-06-02 19:00:11.735280] E [xlator.c:406:xlator_init] 0-management: Initialization of volume 'management' failed, review your volfile again
[2015-06-02 19:00:11.735288] E [graph.c:322:glusterfs_graph_init] 0-management: initializing translator failed
[2015-06-02 19:00:11.735293] E [graph.c:525:glusterfs_graph_activate] 0-graph: init failed
[2015-06-02 19:00:11.735509] D [logging.c:1805:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer size reduced. About to flush 3 extra log messages
[2015-06-02 19:00:11.735525] D [logging.c:1808:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 3 extra log messages
[2015-06-02 19:00:11.735736] W [glusterfsd.c:1182:cleanup_and_exit] (--> 0-: received signum (0), shutting down
[2015-06-02 19:00:11.735761] D [glusterfsd-mgmt.c:2244:glusterfs_mgmt_pmap_signout] 0-fsd-mgmt: portmapper signout arguments not given
Environment
- Red Hat Gluster Storage 3.0
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
