RHOSP introspection failure with

Issue

• We're trying to deploy and overcloud with 1 controller node, using RHOSP 17.1.In the process of introspection ,it proceeds till OS boot and then encounters time out.

• We see the following errors in ironic-conductor.log:

4:2023-12-18 00:01:26.000 2 WARNING ironic.conductor.manager [req-0aead754-a408-42fa-a708-0df8beb9d371 - - - - -] During sync_power_state, could not get power state for node 3e3886ea-893e-452d-99d5-25c80f541555, attempt 1 of 3. Error: The attribute Actions is missing from the resource /redfish/v1/Systems/Partition2.: sushy.exceptions.MissingAttributeError: The attribute Actions is missing from the resource /redfish/v1/Systems/Partition2
7:2023-12-18 00:01:32.906 2 WARNING ironic.conductor.utils [req-0aead754-a408-42fa-a708-0df8beb9d371 - - - - -] Unexpected exception when trying to detect vendor for node bec647e6-0833-46a2-9cc1-ea0d872ba188. MissingAttributeError: The attribute Actions is missing from the resource /redfish/v1/Systems/Partition0: sushy.exceptions.MissingAttributeError: The attribute Actions is missing from the resource /redfish/v1/Systems/Partition0
8:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils Traceback (most recent call last):
9:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 93, in _load
10:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     item = self._get_item(body, name)
11:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 67, in _get_item
12:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return dct[key_or_callable]
13:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils KeyError: 'Actions'
14:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils 
15:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils During handling of the above exception, another exception occurred:
16:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils 
17:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils Traceback (most recent call last):
18:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/ironic/conductor/utils.py", line 1395, in node_cache_vendor
19:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     vendor = task.driver.management.detect_vendor(task)
20:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/ironic/drivers/modules/redfish/management.py", line 725, in detect_vendor
21:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return redfish_utils.get_system(task.node).manufacturer
22:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/ironic/drivers/modules/redfish/utils.py", line 287, in get_system
23:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return _get_connection(
24:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/ironic/drivers/modules/redfish/utils.py", line 373, in _get_connection
25:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return _get_cached_connection(lambda_fun, *args)
26:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 333, in wrapped_f
27:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return self(f, *args, **kw)
28:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 423, in __call__
29:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     do = self.iter(retry_state=retry_state)
30:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 360, in iter
31:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return fut.result()
32:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 439, in result
33:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return self.__get_result()
34:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib64/python3.9/concurrent/futures/_base.py", line 391, in __get_result
35:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     raise self._exception
36:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/tenacity/__init__.py", line 426, in __call__
37:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     result = fn(*args, **kwargs)
38:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/ironic/drivers/modules/redfish/utils.py", line 341, in _get_cached_connection
39:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return lambda_fun(conn, *args)
40:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/ironic/drivers/modules/redfish/utils.py", line 289, in <lambda>
41:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     lambda conn, system_id: conn.get_system(system_id),
42:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/main.py", line 252, in get_system
43:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     return system.System(self._conn, identity,
44:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/system/system.py", line 157, in __init__
45:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     super(System, self).__init__(
46:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 528, in __init__
47:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     self.refresh(json_doc=json_doc)
48:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 626, in refresh
49:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     attributes = self._parse_attributes(self._json)
50:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 566, in _parse_attributes
51:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     setattr(self, attr, field._load(json_doc, self))
52:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 154, in _load
53:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     value = super(CompositeField, self)._load(body, resource)
54:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils   File "/usr/lib/python3.9/site-packages/sushy/resources/base.py", line 100, in _load
55:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils     raise exceptions.MissingAttributeError(
56:2023-12-18 00:01:32.906 2 ERROR ironic.conductor.utils sushy.exceptions.MissingAttributeError: The attribute Actions is missing from the resource /redfish/v1/Systems/Partition0