Provisioning overcloud nodes fails if irmc driver is used for baremetal nodes.

Solution In Progress - Updated -

Issue

  • Provisioning overcloud nodes always fails with timeout error if irmc driver is used for baremetal nodes.
$ openstack overcloud node provision \
  --stack osp170e1r1 \
  --network-config \
  --output ~/templates/baremetal-deployed-environment.yaml \
  -y \
  ~/templates/custom-node-data.yaml
[DEPRECATION WARNING]: ANSIBLE_CALLBACK_WHITELIST option, normalizing names to
new standard, use ANSIBLE_CALLBACKS_ENABLED instead. This feature will be
removed from ansible-core in version 2.15. Deprecation warnings can be disabled
 by setting deprecation_warnings=False in ansible.cfg.

...

2022-10-13 13:58:43.197195 | 52540058-2980-6d36-530a-00000000001a |       TASK | Provision instances
2022-10-13 14:30:12.157653 | 52540058-2980-6d36-530a-00000000001a |      FATAL | Provision instances | localhost | error={"changed": false, "logging": "Created port Controller-ctlplane (UUID f973cba7-327e-41ab-b3ed-a854d027ee44) for node Controller (UUID 7ce38d16-231c-4f5d-9594-bd0097ea157b) with {'network_id': '4a9a9435-b6b3-4b64-bd39-354fe0c944ee', 'name': 'Controller-ctlplane'}\nCreated port Compute-ctlplane (UUID e0073287-9128-4e5a-baec-26b9c24e7474) for node Compute (UUID 237428cc-304c-412e-b360-08f7177555bf) with {'network_id': '4a9a9435-b6b3-4b64-bd39-354fe0c944ee', 'name': 'Compute-ctlplane'}\nAttached port Compute-ctlplane (UUID e0073287-9128-4e5a-baec-26b9c24e7474) to node Compute (UUID 237428cc-304c-412e-b360-08f7177555bf)\nAttached port Controller-ctlplane (UUID f973cba7-327e-41ab-b3ed-a854d027ee44) to node Controller (UUID 7ce38d16-231c-4f5d-9594-bd0097ea157b)\nProvisioning started on node Compute (UUID 237428cc-304c-412e-b360-08f7177555bf)\nProvisioning started on node Controller (UUID 7ce38d16-231c-4f5d-9594-bd0097ea157b)\n", "msg": "Node 237428cc-304c-412e-b360-08f7177555bf reached failure state \"deploy failed\"; the last error is Timeout reached while waiting for callback for node 237428cc-304c-412e-b360-08f7177555bf"}
2022-10-13 14:30:12.159572 | 52540058-2980-6d36-530a-00000000001a |     TIMING | Provision instances | localhost | 0:31:39.423441 | 1888.96s

NO MORE HOSTS LEFT *************************************************************

PLAY RECAP *********************************************************************
localhost                  : ok=10   changed=2    unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2022-10-13 14:30:12.164815 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-10-13 14:30:12.165293 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Total Tasks: 17         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-10-13 14:30:12.165741 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Elapsed Time: 0:31:39.429640 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-10-13 14:30:12.166188 |                                 UUID |       Info |       Host |   Task Name |   Run Time
2022-10-13 14:30:12.166663 | 52540058-2980-6d36-530a-00000000001a |    SUMMARY |  localhost | Provision instances | 1888.96s
2022-10-13 14:30:12.167110 | 52540058-2980-6d36-530a-000000000017 |    SUMMARY |  localhost | Reserve instances | 6.02s
2022-10-13 14:30:12.167573 | 52540058-2980-6d36-530a-000000000016 |    SUMMARY |  localhost | Find existing instances | 1.80s
2022-10-13 14:30:12.168079 | 52540058-2980-6d36-530a-000000000015 |    SUMMARY |  localhost | Expand roles | 1.17s
2022-10-13 14:30:12.168592 | 52540058-2980-6d36-530a-00000000000b |    SUMMARY |  localhost | Check if baremetal deployment file already exist | 0.38s
2022-10-13 14:30:12.169031 | 52540058-2980-6d36-530a-00000000000f |    SUMMARY |  localhost | stat overcloud-hardened-uefi-full.raw | 0.24s
2022-10-13 14:30:12.169491 | 52540058-2980-6d36-530a-00000000000e |    SUMMARY |  localhost | stat overcloud-full.raw | 0.23s
2022-10-13 14:30:12.169918 | 52540058-2980-6d36-530a-000000000010 |    SUMMARY |  localhost | stat overcloud-full.initrd | 0.23s
2022-10-13 14:30:12.170373 | 52540058-2980-6d36-530a-000000000011 |    SUMMARY |  localhost | Set partition file based default image | 0.04s
2022-10-13 14:30:12.170793 | 52540058-2980-6d36-530a-000000000018 |    SUMMARY |  localhost | Metalsmith log for reserve instances | 0.04s
2022-10-13 14:30:12.171243 | 52540058-2980-6d36-530a-000000000013 |    SUMMARY |  localhost | Set glance based default image | 0.03s
2022-10-13 14:30:12.171659 | 52540058-2980-6d36-530a-000000000012 |    SUMMARY |  localhost | Set whole-disk file based default image | 0.03s
2022-10-13 14:30:12.172071 | 52540058-2980-6d36-530a-000000000019 |    SUMMARY |  localhost | Set concurrency fact | 0.03s
2022-10-13 14:30:12.172526 | 52540058-2980-6d36-530a-00000000000c |    SUMMARY |  localhost | fail | 0.03s
2022-10-13 14:30:12.172949 | 52540058-2980-6d36-530a-000000000008 |    SUMMARY |  localhost | fail | 0.03s
2022-10-13 14:30:12.173411 | 52540058-2980-6d36-530a-000000000009 |    SUMMARY |  localhost | fail | 0.02s
2022-10-13 14:30:12.173824 | 52540058-2980-6d36-530a-00000000000a |    SUMMARY |  localhost | fail | 0.02s
2022-10-13 14:30:12.174259 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ End Summary Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-10-13 14:30:12.174698 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ State Information ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-10-13 14:30:12.175114 | ~~~~~~~~~~~~~~~~~~ Number of nodes which did not deploy successfully: 1 ~~~~~~~~~~~~~~~~~
2022-10-13 14:30:12.175695 |  The following node(s) had failures: localhost
2022-10-13 14:30:12.176252 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Environment

  • Red Hat OpenStack Platform 17.0
  • Red Hat OpenStack Platform 17.1
  • irmc driver is used

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content