Error "Problem creating instance: InvalidBDM: Block Device Mapping is Invalid" when trying to create an instance using Horizon (OpenStack Dashboard)

Issue

• When we try to create a new instance in our RHOS 4.0 setup, we get the following traceback in the compute.log:

2014-03-27 08:39:41.751 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:42.001 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:42.219 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:43.421 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:44.626 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:45.810 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:45.999 9477 WARNING pute.manager [req-47ec700d-6335-4166-acdb-344fa054d1db 40fdde0b68084dd599439b071f38305b bb29a94ac3fd4116b8888bf979bbc09a] Volume id: ae63ccc9-1a2d-4f5a-8e9c-039575505649 finished being created but was not set as 'available'
2014-03-27 08:39:46.045 9477 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 10.0.0.4
2014-03-27 08:39:46.232 9477 ERROR pute.manager [req-47ec700d-6335-4166-acdb-344fa054d1db 40fdde0b68084dd599439b071f38305b bb29a94ac3fd4116b8888bf979bbc09a] [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1] Instance failed block device setup
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1] Traceback (most recent call last):
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1392, in _prep_block_device
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]     self._await_block_device_map_created))
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]   File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 283, in attach_block_devices
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]     block_device_mapping)
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]   File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 246, in attach
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]     db_api)
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]   File "/usr/lib/python2.6/site-packages/nova/virt/block_device.py", line 153, in attach
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]     volume_api.check_attach(context, volume, instance=instance)
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]   File "/usr/lib/python2.6/site-packages/nova/volume/cinder.py", line 231, in check_attach
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1]     raise exception.InvalidVolume(reason=msg)
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1] InvalidVolume: Invalid volume: status must be 'available'
2014-03-27 08:39:46.232 9477 TRACE pute.manager [instance: db8cc644-a31a-4b61-acb5-6662ce5c6ea1] 
2014-03-27 08:39:47.076 9477 ERROR mon.rpc.amqp [req-47ec700d-6335-4166-acdb-344fa054d1db 40fdde0b68084dd599439b071f38305b bb29a94ac3fd4116b8888bf979bbc09a] Exception during message handling
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp Traceback (most recent call last):
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     **args)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     payload)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     return f(self, context, *args, **kw)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in decorated_function
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     pass
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in decorated_function
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     return function(self, context, *args, **kwargs)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in decorated_function
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     function(self, context, *args, **kwargs)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in decorated_function
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     e, sys.exc_info())
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in decorated_function
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     return function(self, context, *args, **kwargs)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1630, in run_instance
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     do_run_instance()
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     return f(*args, **kwargs)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1629, in do_run_instance
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     legacy_bdm_in_spec)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 968, in _run_instance
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     notify("error", msg=unicode(e))  # notify that build failed
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 952, in _run_instance
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     instance, image_meta, legacy_bdm_in_spec)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1081, in _build_instance
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     LOG.exception(msg, instance=instance)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1034, in _build_instance
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     context, instance, bdms)
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1409, in _prep_block_device
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp     raise exception.InvalidBDM()
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp InvalidBDM: Block Device Mapping is Invalid.
2014-03-27 08:39:47.076 9477 TRACE mon.rpc.amqp