ironic_pxe_http container is showing unhealthy
Environment
- Red Hat OpenStack Platform 17.1
Issue
- After deploying the undercloud, the ironic_pxe_http container is showing unhealthy:
(undercloud) [stack@undercloud ~]$ sudo podman inspect --format '{{.Name}}: {{.State.Health.Status}}' ironic_pxe_http
ironic_pxe_http: unhealthy
Resolution
- Bugzilla 2234820 was opened to track this issue.
Root Cause
- The healthcheck script not able to get a directory listing on /var/lib/ironic/httpboot because the autoindex module is not loaded.
- This change: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/855562 was backported to stable/wallaby and disabled autoindex.
Diagnostic Steps
- By running a podman inspect on the ironic_pxe_http container, we see the healthcheck curl returns a 404:
(undercloud) [stack@undercloud ~]$ sudo podman inspect ironic_pxe_http | grep -A9 '"Health"'
"Health": {
"Status": "unhealthy",
"FailingStreak": 80011,
"Log": [
{
"Start": "2023-09-15T10:54:29.782292896-04:00",
"End": "2023-09-15T10:54:30.209941293-04:00",
"ExitCode": 1,
"Output": "/usr/sbin/httpd -DFOREGROUND\ncurl: (22) The requested URL returned error: 404\n\n404 192.168.20.1:8088 0.001936 seconds"
},
- Doing a curl on a file will return the expected result:
(undercloud) [stack@undercloud ~]$ sudo curl http://192.168.20.1:8088/inspector.ipxe
#!ipxe
:retry_boot
imgfree
kernel --timeout 60000 http://192.168.20.1:8088/agent.kernel ipa-inspection-callback-url=http://192.168.20.1:5050/v1/continue ipa-inspection-collectors=default,extra-hardware,numa-topology,logs systemd.journald.forward_to_console=yes BOOTIF=${mac} ipa-debug=1 ipa-inspection-dhcp-all-interfaces=1 ipa-collect-lldp=1 initrd=agent.ramdisk || goto retry_boot
initrd --timeout 60000 http://192.168.20.1:8088/agent.ramdisk || goto retry_boot
boot
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.
Comments