Unable to delete snapshot in Red Hat Gluster Storage

Solution Verified - Updated -

Issue

  • A Snapshot created by the snap_scheduler.py can't be deleted
  • When attempting to delete a snapshot created by Red Hat Gluster Storage, the following error is reported back
root@glusternode1 ~# gluster snapshot delete Scheduled_hiho_foobar_GMT-2017.06.05-16.03.01
Deleting snap will erase all the information about the snap. Do you still want to continue? (y/n) y
snapshot delete: failed: Snapshot Scheduled_hiho_foobar_GMT-2017.06.05-16.03.01 might not be in an usable state.
Snapshot command failed
  • The following error is reported in glusterfs logs when attempting to delete a snapshot created via snap_scheduler.py
[2017-06-06 15:00:01.880053] I [MSGID: 106091] [glusterd-snapshot.c:6263:glusterd_snapshot_remove_commit] 0-management: Successfully marked snap Scheduled-abc_GMT-2017.06.05-16.03.01 for decommission.
[2017-06-06 15:00:01.889988] E [MSGID: 106095] [glusterd-snapshot-utils.c:3365:glusterd_umount] 0-management: umounting /run/gluster/snaps/6b97f18c7fdc4f8e8fa2b947be92152f/brick1 failed (Bad file descriptor) [Bad file descriptor]
The message "E [MSGID: 106095] [glusterd-snapshot-utils.c:3365:glusterd_umount] 0-management: umounting /run/gluster/snaps/6b97f18c7fdc4f8e8fa2b947be92152f/brick1 failed (Bad file descriptor) [Bad file descriptor]" repeated 2 times between [2017-06-06 15:00:01.889988] and [2017-06-06 15:00:03.900999]
[2017-06-06 15:00:04.901043] E [MSGID: 106038] [glusterd-snapshot.c:2818:glusterd_do_lvm_snapshot_remove] 0-management: umount failed for path /run/gluster/snaps/6b97f18c7fdc4f8e8fa2b947be92152f/brick1 (brick: /run/gluster/snaps/6b97f18c7fdc4f8e8fa2b947be92152f/brick1/registry): Bad file descriptor.
[2017-06-06 15:00:04.901082] E [MSGID: 106044] [glusterd-snapshot.c:2962:glusterd_lvm_snapshot_remove] 0-management: Failed to remove the snapshot /run/gluster/snaps/6b97f18c7fdc4f8e8fa2b947be92152f/brick1/registry (/dev/vg_fast_registry/6b97f18c7fdc4f8e8fa2b947be92152f_0)
[2017-06-06 15:00:09.536674] W [MSGID: 106033] [glusterd-snapshot.c:3008:glusterd_lvm_snapshot_remove] 0-management: Failed to rmdir: /run/gluster/snaps/6b97f18c7fdc4f8e8fa2b947be92152f/, err: Directory not empty. More than one glusterd running on this node. [Directory not empty]
[2017-06-06 15:00:09.536711] W [MSGID: 106044] [glusterd-snapshot.c:3079:glusterd_snap_volume_remove] 0-management: Failed to remove lvm snapshot volume 6b97f18c7fdc4f8e8fa2b947be92152f
[2017-06-06 15:00:09.536721] W [MSGID: 106044] [glusterd-snapshot.c:3154:glusterd_snap_remove] 0-management: Failed to remove volinfo 6b97f18c7fdc4f8e8fa2b947be92152f for snap Scheduled-vol_fast_registry_snap-vol_fast_registry_GMT-2017.06.05-16.03.01
[2017-06-06 15:00:09.536729] E [MSGID: 106044] [glusterd-snapshot.c:6298:glusterd_snapshot_remove_commit] 0-management: Failed to remove snap Scheduled-abc_GMT-2017.06.05-16.03.01
[2017-06-06 15:00:09.536739] E [MSGID: 106044] [glusterd-snapshot.c:8308:glusterd_snapshot] 0-management: Failed to delete snapshot

Environment

  • Red Hat Gluster Storage 3.1

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content