Overcloud node provision fails in task "Run tripleo_os_net_config_module with network_config" with "failed to bind device <pci_address> to driver vfio-pci"

Solution Verified - Updated -

Issue

openstack overcloud node provision command fails with the following error (failed to bind device <pci_address> to driver vfio-pci):

2023-10-25 06:53:52.492443 | 9440c980-d048-2a5b-b455-00000000019d |      FATAL | Run tripleo_os_net_config_module with network_config | <hostname> | error={"ansible_job_id": "715412396394.4667", "changed": false, "finished": 1, "msg": "Running os-net-config --config-file /etc/os-net-config/config.yaml --debug --detailed-exit-codes failed with return code 1.", "rc": 1, "results_file": "/root/.ansible_async/715412396394.4667", "started": 1, 
"stderr": "Traceback (most recent call last):\n  File \"/usr/lib/python3.9/site-packages/os_net_config/common.py\", line 253, in set_driverctl_override\n    out, err = processutils.execute('driverctl', 'set-override',\n  File \"/usr/lib/python3.9/site-packages/oslo_concurrency/processutils.py\", line 438, in execute\n    raise ProcessExecutionError(exit_code=_returncode,\noslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.\n
Command: driverctl set-override 0000:12:00.0 vfio-pci\nExit code: 1\nStdout: ''\nStderr: 'driverctl: failed to bind device 0000:12:00.0 to driver vfio-pci\\n'\n\n
During handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File \"/bin/os-net-config\", line 10, in <module>\n    sys.exit(main())\n  File \"/usr/lib/python3.9/site-packages/os_net_config/cli.py\", line 335, in main\n    provider.add_object(obj)\n  File \"/usr/lib/python3.9/site-packages/os_net_config/__init__.py\", line 70, in add_object\n    self.add_object(member)\n  File \"/usr/lib/python3.9/site-packages/os_net_config/__init__.py\", line 106, in add_object\n    self.add_ovs_dpdk_bond(obj)\n  File \"/usr/lib/python3.9/site-packages/os_net_config/impl_ifcfg.py\", line 1009, in add_ovs_dpdk_bond\n    utils.bind_dpdk_interfaces(ifname, dpdk_port.driver, self.noop)\n  File \"/usr/lib/python3.9/site-packages/os_net_config/utils.py\", line 241, in bind_dpdk_interfaces\n    err = common.set_driverctl_override(pci_address, driver)\n  File \"/usr/lib/python3.9/site-packages/os_net_config/common.py\", line 260, in set_driverctl_override\n    raise OvsDpdkBindException(msg)\nos_net_config.common.OvsDpdkBindException: Failed to bind interface 0000:12:00.0 with dpdk\n", "stderr_lines": ["Traceback (most recent call last):", "  File \"/usr/lib/python3.9/site-packages/os_net_config/common.py\", line 253, in set_driverctl_override", "    out, err = processutils.execute('driverctl', 'set-override',", "  File \"/usr/lib/python3.9/site-packages/oslo_concurrency/processutils.py\", line 438, in execute", "    raise ProcessExecutionError(exit_code=_returncode,", "oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.", "Command: driverctl set-override 0000:12:00.0 vfio-pci", "Exit code: 1", "Stdout: ''", "Stderr: 'driverctl: failed to bind device 0000:12:00.0 to driver vfio-pci\\n'", "", "During handling of the above exception, another exception occurred:", "", "Traceback

Environment

  • Red Hat OpenStack Platform 17.1
  • Red Hat OpenStack Platform 17.0

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content