DG pods cannot come up: TimeoutException: ISPN000638: Timeout waiting for topology 2 transaction data

Issue

Data Grid pods cannot come up and the threads show:

2025-07-30T06:39:53.563580245Z 06:39:53,562 FATAL (main) [org.infinispan.SERVER] ISPN080028: Red Hat Data Grid Server failed to start org.infinispan.manager.EmbeddedCacheManagerStartupException: ISPN000659: Component ComponentWrapper{name=org.infinispan.globalstate.GlobalConfigurationManager, instance=org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl@21688427, status=FAILED} failed to start
2025-07-30T06:39:53.563580245Z  at org.infinispan.manager.DefaultCacheManager.internalStart(DefaultCacheManager.java:781)
2025-07-30T06:39:53.563580245Z  at org.infinispan.manager.DefaultCacheManager.start(DefaultCacheManager.java:746)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.SecurityActions.lambda$startCacheManager$0(SecurityActions.java:42)
2025-07-30T06:39:53.563580245Z  at org.infinispan.security.Security.doPrivileged(Security.java:62)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.SecurityActions.startCacheManager(SecurityActions.java:44)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.Server.run(Server.java:456)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.Bootstrap.runInternal(Bootstrap.java:184)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.tool.Main.run(Main.java:98)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.Bootstrap.main(Bootstrap.java:67)
2025-07-30T06:39:53.563580245Z  at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
2025-07-30T06:39:53.563580245Z  at java.base/java.lang.reflect.Method.invoke(Method.java:580)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.loader.Loader.run(Loader.java:104)
2025-07-30T06:39:53.563580245Z  at org.infinispan.server.loader.Loader.main(Loader.java:49)
2025-07-30T06:39:53.563580245Z Caused by: org.infinispan.commons.CacheConfigurationException: ISPN000659: Component ComponentWrapper{name=org.infinispan.globalstate.GlobalConfigurationManager, instance=org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl@21688427, status=FAILED} failed to start
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.impl.BasicComponentRegistryImpl.startWrapper(BasicComponentRegistryImpl.java:584)
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.impl.BasicComponentRegistryImpl$ComponentWrapper.running(BasicComponentRegistryImpl.java:807)
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.AbstractComponentRegistry.internalStart(AbstractComponentRegistry.java:370)
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.AbstractComponentRegistry.start(AbstractComponentRegistry.java:243)
2025-07-30T06:39:53.563580245Z  at org.infinispan.manager.DefaultCacheManager.internalStart(DefaultCacheManager.java:778)
2025-07-30T06:39:53.563580245Z  ... 12 more
2025-07-30T06:39:53.563580245Z Caused by: java.util.concurrent.CompletionException: org.infinispan.commons.TimeoutException: ISPN000638: Timeout waiting for topology 2 transaction data
2025-07-30T06:39:53.563580245Z  at org.infinispan.commons.util.concurrent.CompletionStages.join(CompletionStages.java:91)
2025-07-30T06:39:53.563580245Z  at org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.lambda$start$3(GlobalConfigurationManagerImpl.java:155)
2025-07-30T06:39:53.563580245Z  at java.base/java.util.HashMap.forEach(HashMap.java:1429)
2025-07-30T06:39:53.563580245Z  at org.infinispan.globalstate.impl.GlobalConfigurationManagerImpl.start(GlobalConfigurationManagerImpl.java:152)
2025-07-30T06:39:53.563580245Z  at org.infinispan.globalstate.impl.CorePackageImpl$1.start(CorePackageImpl.java:41)
2025-07-30T06:39:53.563580245Z  at org.infinispan.globalstate.impl.CorePackageImpl$1.start(CorePackageImpl.java:28)
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.impl.BasicComponentRegistryImpl.invokeStart(BasicComponentRegistryImpl.java:616)
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.impl.BasicComponentRegistryImpl.doStartWrapper(BasicComponentRegistryImpl.java:607)
2025-07-30T06:39:53.563580245Z  at org.infinispan.factories.impl.BasicComponentRegistryImpl.startWrapper(BasicComponentRegistryImpl.java:576)
2025-07-30T06:39:53.563580245Z  ... 16 more
2025-07-30T06:39:53.563580245Z Caused by: org.infinispan.commons.TimeoutException: ISPN000638: Timeout waiting for topology 2 transaction data
2025-07-30T06:39:53.563580245Z  at org.infinispan.statetransfer.StateTransferLockImpl.transactionDataTimeoutException(StateTransferLockImpl.java:133)
2025-07-30T06:39:53.563580245Z  at org.infinispan.statetransfer.StateTransferLockImpl.lambda$transactionDataFuture$2(StateTransferLockImpl.java:126)
2025-07-30T06:39:53.563580245Z  at org.infinispan.util.concurrent.ConditionFuture.lambda$newConditionStage$0(ConditionFuture.java:60)
2025-07-30T06:39:53.563580245Z  at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
2025-07-30T06:39:53.563580245Z  at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
2025-07-30T06:39:53.563580245Z  at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2025-07-30T06:39:53.563580245Z  at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2025-07-30T06:39:53.563580245Z  at java.base/java.lang.Thread.run(Thread.java:1583)