Openstack FFU to 17.1 undercloud upgrade fail because of ironic_inspector not running
Environment
- Red Hat OpenStack Platform 17.1
Issue
The undercloud upgrade fail in step "migrate existing introspection data" with "container state improper".
Resolution
- Copy the configuration file from ironic to ironic_inspector path.
[root@undercloud ~]$ mkdir /var/lib/config-data/puppet-generated/ironic_inspector/etc/my.cnf.d
[root@undercloud ~]$ cp /var/lib/config-data/puppet-generated/ironic/etc/my.cnf.d/tripleo.cnf /var/lib/config-data/puppet-generated/ironic_inspector/etc/my.cnf.d/
[root@undercloud ~]$ ll -lt /var/lib/config-data/puppet-generated/ironic_inspector/etc/my.cnf.d
- Restart ironic_inspector service.
[root@undercloud ~]$ systemctl restart tripleo_ironic_inspector.service
- Wait 10 seconds and check if container is up.
[root@undercloud ~]$ systemctl status tripleo_ironic_inspector.service
[root@undercloud ~]$ podman ps | grep ironic_inspector
Root Cause
This is a second try of the undercloud upgrade because first failed and removed the configuration files of version 16.
Diagnostic Steps
- Check for ironic-inspector logs.
[root@undercloud ~]$ grep CRITICAL var/log/containers/ironic-inspector/ironic-inspector.log
2024-05-28 12:12:12.453 7 DEBUG ironic_inspector.common.service_utils [-] rate_limit_except_level = CRITICAL log_opt_values /usr/lib/python3.6/site-packages/oslo_config/cfg.py:2581
2024-05-28 12:12:12.786 7 DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL log_opt_values /usr/lib/python3.6/site-packages/oslo_config/cfg.py:2581
2024-05-28 12:12:12.094 7 CRITICAL ironic_inspector.conductor.manager [-] The following hook(s) are missing or failed to load: physnet_cidr_map: RuntimeError: The following hook(s) are missing or failed to load: physnet_cidr_map
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.
Comments