Unable to add worker node in OpenShift Container Platform 4 due to outdated mirror registry configuration

Solution Verified - Updated -

Issue

  • Unable to add worker nodes in a disconnected OpenShift Container Platform (OCP) environment
  • Encountering an error during the creation process as the base iso image cannot be pulled.
  • The node-joiner pod that is created for this process fails to pull the necessary RHCOS ISO image from the private mirror registry.
time=2025-06-12T13:20:49Z level=fatal msg=failed to fetch Agent Installer ISO: failed to fetch dependency of "Agent Installer ISO": failed to fetch dependency of "Agent Installer Artifacts": failed to generate asset "BaseIso Image": failed to get base ISO image: failed to download base ISO image https://rhcos.mirror.openshift.com/art/storage/prod/streams/4.17-9.4/builds/417.94.202410090854-0/x86_64/rhcos-417.94.202410090854-0-live.x86_64.iso: Get "https://rhcos.mirror.openshift.com/art/storage/prod/streams/4.17-9.4/builds/417.94.202410090854-0/x86_64/rhcos-417.94.202410090854-0-live.x86_64.iso": dial tcp: lookup rhcos.mirror.openshift.com on 192.168.x.x:53: read udp 192.168.x.x:59685->192.168.x.x:53: i/o timeout
  • Logs from the node-joiner pod show errors related to an invalid or incorrect mirror registry, or a 403 Forbidden error when attempting to reach an external registry. The process is "stuck" because the cluster is trying to fetch an image from an outdated source.
I0627 16:45:15.791498 2027102 create.go:479] Running command on pod openshift-node-joiner-fgfbf/node-joiner-zpbsk: [cat /assets/exit_code]
I0627 16:45:15.822962 2027102 fallback.go:56] RemoteCommand fallback: unable to upgrade streaming request: websocket: bad handshake (403 Forbidden)
2025-06-27T16:45:46Z [node-image create] unexpected error caught while running the command, storing pod logs in report
2025-06-27T16:45:46Z [node-image create] command execution failed. Reason: error caught while executing remote command: Internal error occurred: error executing command in container: container is not created or running. Error output: cat: /assets/exit_code: No such file or directory

Environment

  • Red Hat OpenShift Container Platform 4.16+
  • Disconnected or restricted network environment

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content