Getting infinispan error ISPN000136/WFLYCLWEBINF0004/ISPN000299 repeatedly at 15 second intervals

Issue

The following error is repeatedly logged to server.log at 15 second intervals:

2024-08-29 21:16:12,318 ERROR [org.infinispan.interceptors.impl.InvocationContextInterceptor] (timeout-thread--p13-t1) ISPN000136: Error executing command RemoveCommand on Cache 'session-test.war', writing keys [SessionCreationMetaDataKey(rJp4WJ3Q8ILeWprpe3b_OmCKkKr-xihHdI5TXbd-)]: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key SessionCreationMetaDataKey(rJp4WJ3Q8ILeWprpe3b_OmCKkKr-xihHdI5TXbd-) and requestor GlobalTransaction{id=134, addr=node1, remote=false, xid=null, internalId=-1}. Lock is held by GlobalTransaction{id=5, addr=node2, remote=true, xid=null, internalId=-1} (pending)
        at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager.timeout(DefaultPendingLockManager.java:149)
        at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager.access$300(DefaultPendingLockManager.java:49)
        at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager$PendingLockPromiseImpl.onRelease(DefaultPendingLockManager.java:329)
        at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager$PendingLockPromiseImpl.call(DefaultPendingLockManager.java:294)
        at org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager$PendingLockPromiseImpl.call(DefaultPendingLockManager.java:247)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:750)

2024-08-29 21:16:12,327 WARN  [org.wildfly.clustering.web.infinispan] (LocalScheduler - 1) WFLYCLWEBINF0004: Failed to expire session rJp4WJ3Q8ILeWprpe3b_OmCKkKr-xihHdI5TXbd-: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key SessionCreationMetaDataKey(rJp4WJ3Q8ILeWprpe3b_OmCKkKr-xihHdI5TXbd-) and requestor GlobalTransaction{id=134, addr=node1, remote=false, xid=null, internalId=-1}. Lock is held by GlobalTransaction{id=5, addr=node2, remote=true, xid=null, internalId=-1} (pending)
        at org.infinispan.interceptors.impl.AsyncInterceptorChainImpl.invoke(AsyncInterceptorChainImpl.java:255)
        at org.infinispan.cache.impl.InvocationHelper.doInvoke(InvocationHelper.java:298)
        at org.infinispan.cache.impl.InvocationHelper.invoke(InvocationHelper.java:102)
        at org.infinispan.cache.impl.InvocationHelper.invoke(InvocationHelper.java:84)
        at org.infinispan.cache.impl.CacheImpl.remove(CacheImpl.java:685)
        at org.infinispan.cache.impl.DecoratedCache.remove(DecoratedCache.java:542)
        at org.infinispan.cache.impl.AbstractDelegatingCache.remove(AbstractDelegatingCache.java:454)
        at org.infinispan.cache.impl.EncoderCache.remove(EncoderCache.java:720)
        at org.infinispan.cache.impl.AbstractDelegatingCache.remove(AbstractDelegatingCache.java:454)
        at org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.delete(InfinispanSessionMetaDataFactory.java:154)
        at org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.remove(InfinispanSessionMetaDataFactory.java:140)
        at org.wildfly.clustering.web.infinispan.session.InfinispanSessionMetaDataFactory.remove(InfinispanSessionMetaDataFactory.java:54)
        at org.wildfly.clustering.web.cache.session.CompositeSessionFactory.remove(CompositeSessionFactory.java:89)
        at org.wildfly.clustering.web.cache.session.CompositeSessionFactory.remove(CompositeSessionFactory.java:40)
        at org.wildfly.clustering.web.infinispan.session.ExpiredSessionRemover.remove(ExpiredSessionRemover.java:69)
        at org.wildfly.clustering.web.infinispan.session.ExpiredSessionRemover.remove(ExpiredSessionRemover.java:45)
        at org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.test(SessionExpirationScheduler.java:101)
        at org.wildfly.clustering.web.infinispan.session.SessionExpirationScheduler.test(SessionExpirationScheduler.java:45)
        at org.wildfly.clustering.ee.cache.scheduler.LocalScheduler.run(LocalScheduler.java:140)
        ...
Caused by: org.infinispan.util.concurrent.TimeoutException: ISPN000299: Unable to acquire lock after 15 seconds for key SessionCreationMetaDataKey(rJp4WJ3Q8ILeWprpe3b_OmCKkKr-xihHdI5TXbd-) and requestor GlobalTransaction{id=134, addr=node1, remote=false, xid=null, internalId=-1}. Lock is held by GlobalTransaction{id=5, addr=node2, remote=true, xid=null, internalId=-1} (pending)
        ...