RHV: Migration hangs, never connects to the destination host

Solution In Progress - Updated -

Issue

  • VM migration hangs and has to be cancelled.

  • The logs files do not indicate any specific error or problem.

  • VDSM would accept the migration request on the source host, but then just not proceed at all.

  • The vdsm logs on the source host would contain only the following;

vdsm.log.11.xz:2020-09-18 15:55:05,766-0600 INFO  (jsonrpc/2) [vdsm.api] START migrate(params={u'incomingLimit': 1, u'src': u'xx.xx.xx.x2', u'dstqemu': u'xx.xx.xx.x3', u'autoConverge': u'true', u'tunneled': u'false', u'enableGuestEvents': True, u'dst': u'xx.xx.xx.x3:54321', u'convergenceSchedule': {u'init': [{u'params': [u'100'], u'name': u'setDowntime'}], u'stalling': [{u'action': {u'params': [u'150'], u'name': u'setDowntime'}, u'limit': 1}, {u'action': {u'params': [u'200'], u'name': u'setDowntime'}, u'limit': 2}, {u'action': {u'params': [u'300'], u'name': u'setDowntime'}, u'limit': 3}, {u'action': {u'params': [u'400'], u'name': u'setDowntime'}, u'limit': 4}, {u'action': {u'params': [u'500'], u'name': u'setDowntime'}, u'limit': 6}, {u'action': {u'params': [u'5000'], u'name': u'setDowntime'}, u'limit': -1}, {u'action': {u'params': [], u'name': u'abort'}, u'limit': -1}]}, u'vmId': u'99927047-0ba6-4eff-98b1-4cab7d861a0f', u'abortOnError': u'true', u'outgoingLimit': 1, u'compressed': u'true', u'maxBandwidth': 2048, u'method': u'online', 'mode': 'remote'}) from=yy.yy.yy.yy,47158, flow_id=0d6cca10-21fd-4104-a6d8-2ae47379191b (api:46)

vdsm.log.11.xz:2020-09-18 15:55:05,769-0600 INFO  (jsonrpc/2) [vdsm.api] FINISH migrate return={'status': {'message': 'Migration in progress', 'code': 0}, 'progress': 0} from=yy.yy.yy.yy,47158, flow_id=0d6cca10-21fd-4104-a6d8-2ae47379191b (api:52)
  • There were no related entries on the destination host at all, indicating that it had not been contacted by the source host.

  • virsh -r list showed the VM was in a "running" state.

  • virsh -r domjobinfo <vm> showed no active migrations.

  • virsh -c qemu+tls://<dest hostname>/system list hung.

  • The network was configured for jumbo frames.

Environment

  • Red Hat Virtualization (RHV) 4.1

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In