AMQ214016: Failed to create netty connection: java.net.UnknownHostException

Issue

I get an error like below, but this only happens to a few artemis clients ..

ERROR [org.apache.activemq.artemis.core.client] (Periodic Recovery) AMQ214016: Failed to create netty connection: java.net.UnknownHostException: cluster-persistence-amq-broker-s2i-amq-1.broker-amq-headless.abccompany-amq.svc.cluster.local
        at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:797)
        at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1505)
        at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1364)
        at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1298)
        at java.base/java.net.InetAddress.getByName(InetAddress.java:1248)
        at io.netty@4.1.42.Final//io.netty.util.internal.SocketUtils$8.run(SocketUtils.java:146)
        at io.netty@4.1.42.Final//io.netty.util.internal.SocketUtils$8.run(SocketUtils.java:143)
        at java.base/java.security.AccessController.doPrivileged(Native Method)
        at io.netty@4.1.42.Final//io.netty.util.internal.SocketUtils.addressByName(SocketUtils.java:143)
        at io.netty@4.1.42.Final//io.netty.resolver.DefaultNameResolver.doResolve(DefaultNameResolver.java:43)
        at io.netty@4.1.42.Final//io.netty.resolver.SimpleNameResolver.resolve(SimpleNameResolver.java:63)
        at io.netty@4.1.42.Final//io.netty.resolver.SimpleNameResolver.resolve(SimpleNameResolver.java:55)
        at io.netty@4.1.42.Final//io.netty.resolver.InetSocketAddressResolver.doResolve(InetSocketAddressResolver.java:57)
        at io.netty@4.1.42.Final//io.netty.resolver.InetSocketAddressResolver.doResolve(InetSocketAddressResolver.java:32)
        at io.netty@4.1.42.Final//io.netty.resolver.AbstractAddressResolver.resolve(AbstractAddressResolver.java:108)
        at io.netty@4.1.42.Final//io.netty.bootstrap.Bootstrap.doResolveAndConnect0(Bootstrap.java:202)
        at io.netty@4.1.42.Final//io.netty.bootstrap.Bootstrap.access$000(Bootstrap.java:48)
        at io.netty@4.1.42.Final//io.netty.bootstrap.Bootstrap$1.operationComplete(Bootstrap.java:182)
        at io.netty@4.1.42.Final//io.netty.bootstrap.Bootstrap$1.operationComplete(Bootstrap.java:168)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:551)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:604)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:104)
        at io.netty@4.1.42.Final//io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84)
        at io.netty@4.1.42.Final//io.netty.channel.AbstractChannel$AbstractUnsafe.safeSetSuccess(AbstractChannel.java:985)
        at io.netty@4.1.42.Final//io.netty.channel.AbstractChannel$AbstractUnsafe.register0(AbstractChannel.java:505)
        at io.netty@4.1.42.Final//io.netty.channel.AbstractChannel$AbstractUnsafe.access$200(AbstractChannel.java:416)
        at io.netty@4.1.42.Final//io.netty.channel.AbstractChannel$AbstractUnsafe$1.run(AbstractChannel.java:475)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:510)
        at io.netty@4.1.42.Final//io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:388)
        at io.netty@4.1.42.Final//io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
        at io.netty@4.1.42.Final//io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at org.apache.activemq.artemis.journal//org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)

2020-05-06 08:56:12,858 WARN  [org.apache.activemq.artemis.service.extensions.xa.recovery] (Periodic Recovery) AMQ172015: Can not connect to XARecoveryConfig [transportConfiguration=[TransportConfiguration(name=, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=cluster-persistence-amq-broker-s2i-amq-1-broker-amq-headless-abccompany-amq-svc-cluster-local], discoveryConfiguration=null, username=user_01, password=**, JNDI_NAME=java:/jms/remoteCF] on auto-generated resource recovery: ActiveMQNotConnectedException[errorType=NOT_CONNECTED message=AMQ219007: Cannot connect to server(s). Tried with all available servers.]
        at org.apache.activemq.artemis@2.10.1//org.apache.activemq.artemis.core.client.impl.ServerLocatorImpl.createSessionFactory(ServerLocatorImpl.java:816)
        at org.apache.activemq.artemis@2.10.1//org.apache.activemq.artemis.service.extensions.xa.recovery.ActiveMQXAResourceWrapper.connect(ActiveMQXAResourceWrapper.java:311)
        at org.apache.activemq.artemis@2.10.1//org.apache.activemq.artemis.service.extensions.xa.recovery.ActiveMQXAResourceWrapper.getDelegate(ActiveMQXAResourceWrapper.java:239)
        at org.apache.activemq.artemis@2.10.1//org.apache.activemq.artemis.service.extensions.xa.recovery.ActiveMQXAResourceWrapper.recover(ActiveMQXAResourceWrapper.java:69)
        at org.apache.activemq.artemis@2.10.1//org.apache.activemq.artemis.service.extensions.xa.ActiveMQXAResourceWrapperImpl.recover(ActiveMQXAResourceWrapperImpl.java:106)
        at org.jboss.jts//com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.xaRecoveryFirstPass(XARecoveryModule.java:674)
        at org.jboss.jts//com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkFirstPass(XARecoveryModule.java:226)
        at org.jboss.jts//com.arjuna.ats.internal.jta.recovery.arjunacore.XARecoveryModule.periodicWorkFirstPass(XARecoveryModule.java:171)
        at org.jboss.jts//com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.doWorkInternal(PeriodicRecovery.java:770)
        at org.jboss.jts//com.arjuna.ats.internal.arjuna.recovery.PeriodicRecovery.run(PeriodicRecovery.java:382)

2020-05-06 08:56:12,858 WARN  [org.apache.activemq.artemis.service.extensions.xa.recovery] (Periodic Recovery) AMQ172008: XA Recovery can not connect to any broker on recovery [XARecoveryConfig [transportConfiguration=[TransportConfiguration(name=, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=cluster-persistence-amq-broker-s2i-amq-1-broker-amq-headless-abccompany-amq-svc-cluster-local], discoveryConfiguration=null, username=user_01, password=**, JNDI_NAME=java:/jms/remoteCF]]