Overcloud deploy fails with "no valid host" because drac unfinished config jobs
Issue
[root@openstack-manager nova]# grep c3eec8b3-8e8d-402f-8e07-60bd9dc4ae81 /var/log/nova/nova-conductor.log
2017-04-27 22:56:01.618 4429 ERROR nova.scheduler.utils [req-c3eec8b3-8e8d-402f-8e07-60bd9dc4ae81 c28df462e39d4591a6f1f024b85b1f71 ce177f716ed8474cb094b876e62d0d81 - - -] [instance: fdbacf8e-0201-4617-b1b3-ae4d4ad36719] Error from last host: openstack-manager.local (node b5059738-35df-462c-b467-293e10030e04): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1779, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1976, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u"RescheduledException: Build of instance fdbacf8e-0201-4617-b1b3-ae4d4ad36719 was re-scheduled: Failed to provision instance fdbacf8e-0201-4617-b1b3-ae4d4ad36719: Failed to deploy. Error: DRAC operation failed. Reason: Unfinished config jobs found: [Job(id='JID_933730885088', name='ConfigBIOS:BIOS.Setup.1-1', start_time='TIME_NOW', until_time='TIME_NA', message='Task successfully scheduled.', status='Scheduled', percent_complete='0')]. Make sure they are completed before retrying.\n"]
2017-04-27 22:56:13.686 4428 ERROR nova.scheduler.utils [req-c3eec8b3-8e8d-402f-8e07-60bd9dc4ae81 c28df462e39d4591a6f1f024b85b1f71 ce177f716ed8474cb094b876e62d0d81 - - -] [instance: fdbacf8e-0201-4617-b1b3-ae4d4ad36719] Error from last host: openstack-manager.local (node ce6defd9-edba-49cc-b027-7ef753bcd87d): [u'Traceback (most recent call last):\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1779, in _do_build_and_run_instance\n filter_properties)\n', u' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1976, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\n', u"RescheduledException: Build of instance fdbacf8e-0201-4617-b1b3-ae4d4ad36719 was re-scheduled: Failed to provision instance fdbacf8e-0201-4617-b1b3-ae4d4ad36719: Failed to deploy. Error: DRAC operation failed. Reason: Unfinished config jobs found: [Job(id='JID_933432676256', name='ConfigBIOS:BIOS.Setup.1-1', start_time='TIME_NOW', until_time='TIME_NA', message='Task successfully scheduled.', status='Scheduled', percent_complete='0')]. Make sure they are completed before retrying.\n"]
2017-04-27 22:56:13.738 4428 WARNING nova.scheduler.utils [req-c3eec8b3-8e8d-402f-8e07-60bd9dc4ae81 c28df462e39d4591a6f1f024b85b1f71 ce177f716ed8474cb094b876e62d0d81 - - -] Failed to compute_task_build_instances: No valid host was found. There are not enough hosts available.
2017-04-27 22:56:13.739 4428 WARNING nova.scheduler.utils [req-c3eec8b3-8e8d-402f-8e07-60bd9dc4ae81 c28df462e39d4591a6f1f024b85b1f71 ce177f716ed8474cb094b876e62d0d81 - - -] [instance: fdbacf8e-0201-4617-b1b3-ae4d4ad36719] Setting instance to ERROR state.
- ironic-conductor.log
2017-04-27 23:28:36.296 17701 ERROR ironic.drivers.modules.drac.management [req-273f6b63-e8de-4a70-977a-aca24e3ca17f - - - - -] DRAC driver failed to change boot device order for node ce6defd9-edba-49cc-b027-7ef753bcd87d. Reason: DRAC operation failed. Messages: ['Configuration job already created, cannot create another config job on specified target until existing job is completed or is cancelled'].
Environment
- Red Hat Openstack 10
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.