Receive error message "Exceeded maximum number of retries." when building instance on Overcloud
Issue
- Receive error message "Exceeded maximum number of retries." when building instance on Overcloud.
- nova-compute.log shows the NFS mount failure messages for the building instance like below.
2023-07-26 07:10:41.162 2 INFO nova.compute.claims [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Claim successful on node compute-0.redhat.local
2023-07-26 07:10:41.315 2 INFO nova.virt.libvirt.driver [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
2023-07-26 07:10:41.365 2 INFO nova.virt.block_device [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Booting with volume a65ba073-2a81-47b0-b85e-5ed331720d46 at /dev/vda
2023-07-26 07:10:43.000 2 INFO nova.virt.libvirt.driver [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Creating image
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Instance failed to spawn: TypeError: catching classes that do not inherit from BaseException is not allowed
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Traceback (most recent call last):
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] File "/usr/lib/python3.9/site-packages/nova/virt/libvirt/volume/mount.py", line 305, in mount
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] nova.privsep.fs.mount(fstype, export, mountpoint, options)
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] File "/usr/lib/python3.9/site-packages/oslo_privsep/priv_context.py", line 247, in _wrap
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] return self.channel.remote_call(name, args, kwargs)
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] File "/usr/lib/python3.9/site-packages/oslo_privsep/daemon.py", line 224, in remote_call
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] raise exc_type(*result[2])
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Command: mount -t nfs 192.168.0.221:/cinder /var/lib/nova/mnt/4869a152a249149c40d8c04089df5d7c
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Exit code: 32
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Stdout: ''
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Stderr: 'mount.nfs: No route to host\n'
Environment
- Red Hat OpenStack Platform 16.1
- Red Hat OpenStack Platform 16.2
- Cinder backend is NFS
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.