Instance not able to attach to it's volume seeing RTSLibError: Device /dev/cinder-vg01/volume-1777f1d8-2acb-4789-bef6-2cda5dc81d0d is not a TYPE_DISK block device\

Issue

• We have 2 volumes that we can't attach to it's instance. Looking at the cinder logs we see below.

• We are looking for a way to get the two volumes attached again.

• We see the following in /var/log/containers/cinder/cinder-volume.log:

2022-02-25 16:53:23.994 43 INFO cinder.volume.targets.lio [req-3128c3f4-8897-4a44-9cc6-2ff29b5e9056 61c77f70aff04e61982a179dd6b8d426 1063fb8baebc4fa7a43d17e3333595a0 - default default] Creating iscsi_target for volume: volume-81aced72-88c2-4990-a07b-d78cbc4377bd
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio [req-3128c3f4-8897-4a44-9cc6-2ff29b5e9056 61c77f70aff04e61982a179dd6b8d426 1063fb8baebc4fa7a43d17e3333595a0 - default default] Failed to create iscsi target for volume id:volume-81aced72-88c2-4990-a07b-d78cbc4377bd.: ProcessExecutionError: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd iqn.2010-10.org.openstack:volume-81aced72-88c2-4990-a07b-d78cbc4377bd RvDkg4T9AgAVjMpmbE97 TCEPNGM6vAxvVTym False -p3260 -a10.10.10.10
Exit code: 1
Stdout: u''
Stderr: u'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 293, in main\n    **optional_args)\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 61, in create\n    dev=backing_device)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 738, in __init__\n    self._configure(dev, wwn, readonly)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 748, in _configure\n    raise RTSLibError("Device %s is not a TYPE_DISK block device" % dev)\nrtslib_fb.utils.RTSLibError: Device /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd is not a TYPE_DISK block device\n'
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio Traceback (most recent call last):
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 126, in create_iscsi_target
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio     self._execute(*command_args, run_as_root=True)
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio     return f(*args, **kwargs)
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 51, in _execute
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio     return utils.execute(*args, **kwargs)
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 126, in execute
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio     return processutils.execute(*cmd, **kwargs)
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py", line 424, in execute
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio     cmd=sanitized_cmd)
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio ProcessExecutionError: Unexpected error while running command.
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd iqn.2010-10.org.openstack:volume-81aced72-88c2-4990-a07b-d78cbc4377bd RvDkg4T9AgAVjMpmbE97 TCEPNGM6vAxvVTym False -p3260 -a172.18.0.20
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio Exit code: 1
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio Stdout: u''
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio Stderr: u'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 293, in main\n    **optional_args)\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 61, in create\n    dev=backing_device)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 738, in __init__\n    self._configure(dev, wwn, readonly)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 748, in _configure\n    raise RTSLibError("Device %s is not a TYPE_DISK block device" % dev)\nrtslib_fb.utils.RTSLibError: Device /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd is not a TYPE_DISK block device\n'
2022-02-25 16:53:24.493 43 ERROR cinder.volume.targets.lio
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager [req-3128c3f4-8897-4a44-9cc6-2ff29b5e9056 61c77f70aff04e61982a179dd6b8d426 1063fb8baebc4fa7a43d17e3333595a0 - default default] Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).: ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager Traceback (most recent call last):
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4360, in _connection_create
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager     volume, connector)
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 840, in create_export
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager     volume_path)
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/iscsi.py", line 210, in create_export
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager     **portals_config)
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 131, in create_iscsi_target
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager     raise exception.ISCSITargetCreateFailed(volume_id=vol_id)
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.
2022-02-25 16:53:24.496 43 ERROR cinder.volume.manager
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server [req-3128c3f4-8897-4a44-9cc6-2ff29b5e9056 61c77f70aff04e61982a179dd6b8d426 1063fb8baebc4fa7a43d17e3333595a0 - default default] Exception during message handling: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4422, in attachment_update
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server     connector)
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4364, in _connection_create
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server     raise exception.VolumeBackendAPIException(data=err_msg)
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).
2022-02-25 16:53:24.497 43 ERROR oslo_messaging.rpc.server
2022-02-25 17:15:20.817 43 INFO cinder.volume.targets.lio [req-3f90f3ea-9c7d-4e4f-ae94-7148498d8138 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Creating iscsi_target for volume: volume-81aced72-88c2-4990-a07b-d78cbc4377bd
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio [req-3f90f3ea-9c7d-4e4f-ae94-7148498d8138 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Failed to create iscsi target for volume id:volume-81aced72-88c2-4990-a07b-d78cbc4377bd.: ProcessExecutionError: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd iqn.2010-10.org.openstack:volume-81aced72-88c2-4990-a07b-d78cbc4377bd RvDkg4T9AgAVjMpmbE97 TCEPNGM6vAxvVTym False -p3260 -a10.10.10.10
Exit code: 1
Stdout: u''
Stderr: u'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 293, in main\n    **optional_args)\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 61, in create\n    dev=backing_device)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 738, in __init__\n    self._configure(dev, wwn, readonly)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 748, in _configure\n    raise RTSLibError("Device %s is not a TYPE_DISK block device" % dev)\nrtslib_fb.utils.RTSLibError: Device /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd is not a TYPE_DISK block device\n'
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio Traceback (most recent call last):
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 126, in create_iscsi_target
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio     self._execute(*command_args, run_as_root=True)
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio     return f(*args, **kwargs)
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 51, in _execute
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio     return utils.execute(*args, **kwargs)
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 126, in execute
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio     return processutils.execute(*cmd, **kwargs)
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py", line 424, in execute
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio     cmd=sanitized_cmd)
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio ProcessExecutionError: Unexpected error while running command.
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd iqn.2010-10.org.openstack:volume-81aced72-88c2-4990-a07b-d78cbc4377bd RvDkg4T9AgAVjMpmbE97 TCEPNGM6vAxvVTym False -p3260 -a10.10.10.10
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio Exit code: 1
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio Stdout: u''
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio Stderr: u'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 293, in main\n    **optional_args)\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 61, in create\n    dev=backing_device)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 738, in __init__\n    self._configure(dev, wwn, readonly)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 748, in _configure\n    raise RTSLibError("Device %s is not a TYPE_DISK block device" % dev)\nrtslib_fb.utils.RTSLibError: Device /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd is not a TYPE_DISK block device\n'
2022-02-25 17:15:21.309 43 ERROR cinder.volume.targets.lio
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager [req-3f90f3ea-9c7d-4e4f-ae94-7148498d8138 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).: ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager Traceback (most recent call last):
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4360, in _connection_create
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager     volume, connector)
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 840, in create_export
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager     volume_path)
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/iscsi.py", line 210, in create_export
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager     **portals_config)
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 131, in create_iscsi_target
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager     raise exception.ISCSITargetCreateFailed(volume_id=vol_id)
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.
2022-02-25 17:15:21.311 43 ERROR cinder.volume.manager
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server [req-3f90f3ea-9c7d-4e4f-ae94-7148498d8138 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Exception during message handling: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4422, in attachment_update
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server     connector)
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4364, in _connection_create
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server     raise exception.VolumeBackendAPIException(data=err_msg)
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).
2022-02-25 17:15:21.312 43 ERROR oslo_messaging.rpc.server
2022-02-25 17:16:15.742 43 INFO cinder.volume.targets.lio [req-f58e3bc4-1546-4bd7-8714-0a6701af69c9 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Creating iscsi_target for volume: volume-81aced72-88c2-4990-a07b-d78cbc4377bd
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio [req-f58e3bc4-1546-4bd7-8714-0a6701af69c9 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Failed to create iscsi target for volume id:volume-81aced72-88c2-4990-a07b-d78cbc4377bd.: ProcessExecutionError: Unexpected error while running command.
Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd iqn.2010-10.org.openstack:volume-81aced72-88c2-4990-a07b-d78cbc4377bd RvDkg4T9AgAVjMpmbE97 TCEPNGM6vAxvVTym False -p3260 -a10.10.10.10
Exit code: 1
Stdout: u''
Stderr: u'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 293, in main\n    **optional_args)\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 61, in create\n    dev=backing_device)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 738, in __init__\n    self._configure(dev, wwn, readonly)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 748, in _configure\n    raise RTSLibError("Device %s is not a TYPE_DISK block device" % dev)\nrtslib_fb.utils.RTSLibError: Device /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd is not a TYPE_DISK block device\n'
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio Traceback (most recent call last):
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 126, in create_iscsi_target
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio     self._execute(*command_args, run_as_root=True)
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio     return f(*args, **kwargs)
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 51, in _execute
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio     return utils.execute(*args, **kwargs)
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 126, in execute
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio     return processutils.execute(*cmd, **kwargs)
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio   File "/usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py", line 424, in execute
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio     cmd=sanitized_cmd)
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio ProcessExecutionError: Unexpected error while running command.
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf cinder-rtstool create /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd iqn.2010-10.org.openstack:volume-81aced72-88c2-4990-a07b-d78cbc4377bd RvDkg4T9AgAVjMpmbE97 TCEPNGM6vAxvVTym False -p3260 -a172.18.0.20
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio Exit code: 1
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio Stdout: u''
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio Stderr: u'Traceback (most recent call last):\n  File "/bin/cinder-rtstool", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 293, in main\n    **optional_args)\n  File "/usr/lib/python2.7/site-packages/cinder/cmd/rtstool.py", line 61, in create\n    dev=backing_device)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 738, in __init__\n    self._configure(dev, wwn, readonly)\n  File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 748, in _configure\n    raise RTSLibError("Device %s is not a TYPE_DISK block device" % dev)\nrtslib_fb.utils.RTSLibError: Device /dev/cinder-vg01/volume-81aced72-88c2-4990-a07b-d78cbc4377bd is not a TYPE_DISK block device\n'
2022-02-25 17:16:16.240 43 ERROR cinder.volume.targets.lio
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager [req-f58e3bc4-1546-4bd7-8714-0a6701af69c9 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).: ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager Traceback (most recent call last):
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4360, in _connection_create
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager     volume, connector)
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/lvm.py", line 840, in create_export
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager     volume_path)
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/iscsi.py", line 210, in create_export
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager     **portals_config)
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/targets/lio.py", line 131, in create_iscsi_target
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager     raise exception.ISCSITargetCreateFailed(volume_id=vol_id)
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager ISCSITargetCreateFailed: Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.
2022-02-25 17:16:16.242 43 ERROR cinder.volume.manager
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server [req-f58e3bc4-1546-4bd7-8714-0a6701af69c9 a642ce90323149679a44d58a2e553206 9c589d3f2ee846209b8062a93e19818f - default default] Exception during message handling: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4422, in attachment_update
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server     connector)
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4364, in _connection_create
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server     raise exception.VolumeBackendAPIException(data=err_msg)
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Create export for volume failed (Failed to create iscsi target for volume volume-81aced72-88c2-4990-a07b-d78cbc4377bd.).
2022-02-25 17:16:16.243 43 ERROR oslo_messaging.rpc.server