After running updates on 7.0 openstack environment cinder volumes go into error state.
Issue
- Cinder Volumes go into error state and attached instances are unable to boot.
- Logs from the compute node for an attached Instance:
2016-01-12 17:30:23.016 1954 WARNING nova.virt.libvirt.volume [req-2d81734b-4054-4f90-b16a-e76f84553b79 30eae6c6583a4c3e96e2af34b63a64bf bb4eb565696c4cc384cfeae6f6d09166 - - -] ISCSI volume not yet found at: vdb. Will rescan & retry. Try number: 3
2016-01-12 17:30:23.017 1954 DEBUG oslo_concurrency.processutils [req-2d81734b-4054-4f90-b16a-e76f84553b79 30eae6c6583a4c3e96e2af34b63a64bf bb4eb565696c4cc384cfeae6f6d09166 - - -] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26aef583-30d3-4a3a-b80f-dae4898de412 -p 10.10.73.4:3260 --rescan execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:223
2016-01-12 17:30:23.163 1954 DEBUG oslo_concurrency.processutils [req-2d81734b-4054-4f90-b16a-e76f84553b79 30eae6c6583a4c3e96e2af34b63a64bf bb4eb565696c4cc384cfeae6f6d09166 - - -] CMD "sudo nova-rootwrap /etc/nova/rootwrap.conf iscsiadm -m node -T iqn.2010-10.org.openstack:volume-26aef583-30d3-4a3a-b80f-dae4898de412 -p 10.10.73.4:3260 --rescan" returned: 0 in 0.146s execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:254
2016-01-12 17:30:23.165 1954 DEBUG nova.virt.libvirt.volume [req-2d81734b-4054-4f90-b16a-e76f84553b79 30eae6c6583a4c3e96e2af34b63a64bf bb4eb565696c4cc384cfeae6f6d09166 - - -] iscsiadm ('--rescan',): stdout=Rescanning session [sid: 3, target: iqn.2010-10.org.openstack:volume-26aef583-30d3-4a3a-b80f-dae4898de412, portal: 10.10.73.4,3260]
stderr=iscsiadm: invalid error code 65280
iscsiadm: Could not execute operation on all sessions: (null)
_run_iscsiadm /usr/lib/python2.7/site-packages/nova/virt/libvirt/volume.py:365
Environment
- Red Hat OpenStack 7.0
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.