Openstack FFU to 17.1 undercloud upgrade fail because of ironic_inspector not running

Solution In Progress - Updated -

Environment

  • Red Hat OpenStack Platform 17.1

Issue

The undercloud upgrade fail in step "migrate existing introspection data" with "container state improper".

Resolution

  1. Copy the configuration file from ironic to ironic_inspector path.
[root@undercloud ~]$ mkdir /var/lib/config-data/puppet-generated/ironic_inspector/etc/my.cnf.d
[root@undercloud ~]$ cp /var/lib/config-data/puppet-generated/ironic/etc/my.cnf.d/tripleo.cnf /var/lib/config-data/puppet-generated/ironic_inspector/etc/my.cnf.d/
[root@undercloud ~]$ ll -lt /var/lib/config-data/puppet-generated/ironic_inspector/etc/my.cnf.d
  1. Restart ironic_inspector service.
[root@undercloud ~]$ systemctl restart tripleo_ironic_inspector.service
  1. Wait 10 seconds and check if container is up.
[root@undercloud ~]$ systemctl status tripleo_ironic_inspector.service
[root@undercloud ~]$ podman ps | grep ironic_inspector

Root Cause

This is a second try of the undercloud upgrade because first failed and removed the configuration files of version 16.

Diagnostic Steps

  1. Check for ironic-inspector logs.
[root@undercloud ~]$ grep CRITICAL var/log/containers/ironic-inspector/ironic-inspector.log 
2024-05-28 12:12:12.453 7 DEBUG ironic_inspector.common.service_utils [-] rate_limit_except_level        = CRITICAL log_opt_values /usr/lib/python3.6/site-packages/oslo_config/cfg.py:2581
2024-05-28 12:12:12.786 7 DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL log_opt_values /usr/lib/python3.6/site-packages/oslo_config/cfg.py:2581
2024-05-28 12:12:12.094 7 CRITICAL ironic_inspector.conductor.manager [-] The following hook(s) are missing or failed to load: physnet_cidr_map: RuntimeError: The following hook(s) are missing or failed to load: physnet_cidr_map

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments