Receive error message "Exceeded maximum number of retries." when building instance on Overcloud

Solution Verified - Updated -

Issue

  • Receive error message "Exceeded maximum number of retries." when building instance on Overcloud.
  • nova-compute.log shows the NFS mount failure messages for the building instance like below.
2023-07-26 07:10:41.162 2 INFO nova.compute.claims [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Claim successful on node compute-0.redhat.local
2023-07-26 07:10:41.315 2 INFO nova.virt.libvirt.driver [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
2023-07-26 07:10:41.365 2 INFO nova.virt.block_device [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Booting with volume a65ba073-2a81-47b0-b85e-5ed331720d46 at /dev/vda
2023-07-26 07:10:43.000 2 INFO nova.virt.libvirt.driver [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Creating image
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [req-9001ee78-7c8d-492e-baf9-60e093e9ec79 079da6fb3fa548dfb05305f5c6c3d451 1649117e633f461086862a3074bd1c20 - default default] [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Instance failed to spawn: TypeError: catching classes that do not inherit from BaseException is not allowed
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Traceback (most recent call last):
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094]   File "/usr/lib/python3.9/site-packages/nova/virt/libvirt/volume/mount.py", line 305, in mount
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094]     nova.privsep.fs.mount(fstype, export, mountpoint, options)
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094]   File "/usr/lib/python3.9/site-packages/oslo_privsep/priv_context.py", line 247, in _wrap
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094]     return self.channel.remote_call(name, args, kwargs)
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094]   File "/usr/lib/python3.9/site-packages/oslo_privsep/daemon.py", line 224, in remote_call
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094]     raise exc_type(*result[2])
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Command: mount -t nfs 192.168.0.221:/cinder /var/lib/nova/mnt/4869a152a249149c40d8c04089df5d7c
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Exit code: 32
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Stdout: ''
2023-07-26 07:12:56.472 2 ERROR nova.compute.manager [instance: 9aa2faea-42e0-4456-906a-17eb627ea094] Stderr: 'mount.nfs: No route to host\n' 

Environment

  • Red Hat OpenStack Platform 16.1
  • Red Hat OpenStack Platform 16.2
  • Cinder backend is NFS

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content