Failed to reconfigure connector's tasks after upgrading MirrorMaker 2 to 2.9

Solution In Progress - Updated -

Issue

After upgrading MirrorMaker 2 (included in Streams for Apache Kafka) from 2.5 LTS to 2.9 LTS, it is possible to see this error in the log:

[yyyy-mm-dd HH:MM:ss,zzz] ERROR [Worker clientId=backup->active, groupId=backup-mm2] Failed to reconfigure connector's tasks (MirrorCheckpointConnector), retrying after backoff. (org.apache.kafka.connect.runtime.distributed.DistributedHerder:2195)
org.apache.kafka.connect.errors.RetriableException: Timeout while loading consumer groups.
    at org.apache.kafka.connect.mirror.MirrorCheckpointConnector.taskConfigs(MirrorCheckpointConnector.java:138)
    at org.apache.kafka.connect.runtime.Worker.connectorTaskConfigs(Worker.java:398)
    at org.apache.kafka.connect.runtime.distributed.DistributedHerder.reconfigureConnector(DistributedHerder.java:2243)
    at org.apache.kafka.connect.runtime.distributed.DistributedHerder.reconfigureConnectorTasksWithExponentialBackoffRetries(DistributedHerder.java:2183)
    at org.apache.kafka.connect.runtime.distributed.DistributedHerder.lambda$reconfigureConnectorTasksWithExponentialBackoffRetries$47(DistributedHerder.java:2199)
    at org.apache.kafka.connect.runtime.distributed.DistributedHerder.runRequest(DistributedHerder.java:2402)
    at org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:498)
    at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:383)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)

Environment

  • MirrorMaker 2 (in Streams for Apache Kafka 2.9 LTS) in dedicated mode within an active/backup setup
  • Red Hat Enterprise Linux (RHEL) 8.3

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content