instances live-migration failing due to qemu-kvm failure to set MSR

Solution In Progress - Updated -

Issue

  • During rebalancing the instances across all compute nodes, some failed to be migrated and the following error is seen:
79:2020-06-07 14:04:25.320 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Live Migration failure: internal error: process exited while connecting to monitor: 2020-06-07T11:04:24.909739Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
80:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: process exited while connecting to monitor: 2020-06-07T11:04:24.909739Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
81:2020-06-07 14:04:25.553 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Migration operation has aborted
88:2020-06-07 14:06:03.772 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:03.315975Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
89:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:03.315975Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
90:2020-06-07 14:06:03.941 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Migration operation has aborted
98:2020-06-07 14:06:42.202 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:41.622501Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
99:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:41.622501Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
100:2020-06-07 14:06:42.228 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Migration operation has aborted
110:2020-06-07 14:07:52.667 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:07:52.082569Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
111:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:07:52.082569Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
112:2020-06-07 14:07:52.671 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Migration operation has aborted
126:2020-06-07 14:10:34.276 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:10:33.626617Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
127:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:10:33.626617Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
128:2020-06-07 14:10:34.654 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Migration operation has aborted
144:2020-06-07 15:33:51.054 7 INFO nova.compute.manager [-] [instance: 6d3ee2a2-6984-4a01-a406-4634e2ae6d2b] VM Stopped (Lifecycle Event)
  • Stopping and rebooting the instances would also generate those errors.

Environment

  • Red Hat OpenStack Platform 15.0 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In