Failed to set node power state to power on with iLO PXE driver in Red Hat OpenStack Platform

Issue

• When using pxe_ilo driver deploy sometimes fails
• Very inconsistent deploy, sometimes the systems reboot and re-pxe and the deploy command output shows this:

2016-05-17 21:08:47 [Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"
2016-05-17 21:08:47 [Controller]: DELETE_IN_PROGRESS  state changed
2016-05-17 21:08:49 [Controller]: DELETE_COMPLETE  state changed
2016-05-17 21:08:49 [NovaCompute]: CREATE_FAILED  ResourceInError: resources.NovaCompute: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"

• From the ironic logs one can see:

2016-05-19 08:50:38.252 1612 ERROR ironic.drivers.modules.ilo.power [-] iLO failed to change state to power on within 12 sec
2016-05-19 08:50:38.258 1612 ERROR ironic.drivers.modules.agent_base_vendor [-] Error rebooting node cee35d73-c66f-4002-9490-5b2e5585e715 after deploy. Error: Failed to set node power state to power on.

And:

2017-05-03 09:30:39.960 1607 ERROR ironic.drivers.modules.ilo.power [req-5eadd244-f8f9-475e-a6f5-f463cc9dd12d - - - - -] iLO failed to change state to power on within 12 sec