RHV: Migration hangs, never connects to the destination host

Solution In Progress - Updated -

Issue

  • VM migration hangs and has to be cancelled.

  • The logs files do not indicate any specific error or problem.

  • VDSM would accept the migration request on the source host, but then just not proceed at all.

  • The vdsm logs on the source host would contain only the following;

vdsm.log.11.xz:2020-09-18 15:55:05,766-0600 INFO  (jsonrpc/2) [vdsm.api] START migrate(params={u'incomingLimit': 1, u'src': u'xx.xx.xx.x2', u'dstqemu': u'xx.xx.xx.x3', u'autoConverge': u'true', u'tunneled': u'false', u'enableGuestEvents': True, u'dst': u'xx.xx.xx.x3:54321', u'convergenceSchedule': {u'init': [{u'params': [u'100'], u'name': u'setDowntime'}], u'stalling': [{u'action': {u'params': [u'150'], u'name': u'setDowntime'}, u'limit': 1}, {u'action': {u'params': [u'200'], u'name': u'setDowntime'}, u'limit': 2}, {u'action': {u'params': [u'300'], u'name': u'setDowntime'}, u'limit': 3}, {u'action': {u'params': [u'400'], u'name': u'setDowntime'}, u'limit': 4}, {u'action': {u'params': [u'500'], u'name': u'setDowntime'}, u'limit': 6}, {u'action': {u'params': [u'5000'], u'name': u'setDowntime'}, u'limit': -1}, {u'action': {u'params': [], u'name': u'abort'}, u'limit': -1}]}, u'vmId': u'99927047-0ba6-4eff-98b1-4cab7d861a0f', u'abortOnError': u'true', u'outgoingLimit': 1, u'compressed': u'true', u'maxBandwidth': 2048, u'method': u'online', 'mode': 'remote'}) from=yy.yy.yy.yy,47158, flow_id=0d6cca10-21fd-4104-a6d8-2ae47379191b (api:46)

vdsm.log.11.xz:2020-09-18 15:55:05,769-0600 INFO  (jsonrpc/2) [vdsm.api] FINISH migrate return={'status': {'message': 'Migration in progress', 'code': 0}, 'progress': 0} from=yy.yy.yy.yy,47158, flow_id=0d6cca10-21fd-4104-a6d8-2ae47379191b (api:52)
  • There were no related entries on the destination host at all, indicating that it had not been contacted by the source host.

  • virsh -r list showed the VM was in a "running" state.

  • virsh -r domjobinfo <vm> showed no active migrations.

  • virsh -c qemu+tls://<dest hostname>/system list hung.

  • The network was configured for jumbo frames.

Environment

  • Red Hat Virtualization (RHV) 4.1

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content