RHGS - 'glusterd cannot start' or 'volumes cannot be deleted'
Issue
When /var/lib/glusterd/vols is corrupted, then glusterd may fail to start, displaying the following messages:
[2016-05-05 15:48:38.557928] I [MSGID: 100030] [glusterfsd.c:1998:main] 0-/usr/sbin/glusterd: Started running /usr/sbin/glusterd version 3.6.0.28 (args: /usr/sbin/glusterd --pid-file=/run/glusterd.pid)
[2016-05-05 15:48:38.564133] I [glusterd.c:1188:init] 0-management: Maximum allowed open file descriptors set to 65536
[2016-05-05 15:48:38.564183] I [glusterd.c:1233:init] 0-management: Using /var/lib/glusterd as working directory
[2016-05-05 15:48:38.568055] W [rdma.c:4194:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such device)
[2016-05-05 15:48:38.568086] E [rdma.c:4482:init] 0-rdma.management: Failed to initialize IB Device
[2016-05-05 15:48:38.568098] E [rpc-transport.c:333:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed
[2016-05-05 15:48:38.568264] W [rpcsvc.c:1524:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
[2016-05-05 15:48:41.784623] I [glusterd-store.c:1944:glusterd_restore_op_version] 0-glusterd: retrieved op-version: 30000
[2016-05-05 15:48:42.777367] E [glusterd-store.c:2444:glusterd_store_update_volinfo] 0-management: Failed to get next store iter
[2016-05-05 15:48:42.777388] E [glusterd-store.c:2667:glusterd_store_retrieve_volume] 0-management: Failed to update volinfo for test-volume1 volume
[2016-05-05 15:48:42.777406] E [glusterd-store.c:2856:glusterd_store_retrieve_volumes] 0-: Unable to restore volume: test-volume1
[2016-05-05 15:48:42.777455] E [xlator.c:406:xlator_init] 0-management: Initialization of volume 'management' failed, review your volfile again
[2016-05-05 15:48:42.777469] E [graph.c:322:glusterfs_graph_init] 0-management: initializing translator failed
[2016-05-05 15:48:42.777479] E [graph.c:525:glusterfs_graph_activate] 0-graph: init failed
[2016-05-05 15:48:42.778256] W [glusterfsd.c:1182:cleanup_and_exit] (--> 0-: received signum (0), shutting down
Also volumes may not be able to be deleted with the following message:
# gluster vol delete <vol>
Deleting volume will erase all information about the volume. Do you want to
continue? (y/n) y
volume delete: <vol>: failed: Staging failed on nodeb. Error:
Volume <vol> does not exist
Environment
Red Hat Gluster Storage Version 3.0, 3.1
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
