instances live-migration failing due to qemu-kvm failure to set MSR

Solution In Progress - Updated -

Issue

  • During rebalancing the instances across all compute nodes, some failed to be migrated and the following error is seen:
79:2020-06-07 14:04:25.320 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Live Migration failure: internal error: process exited while connecting to monitor: 2020-06-07T11:04:24.909739Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
80:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: process exited while connecting to monitor: 2020-06-07T11:04:24.909739Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
81:2020-06-07 14:04:25.553 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Migration operation has aborted
88:2020-06-07 14:06:03.772 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:03.315975Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
89:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:03.315975Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
90:2020-06-07 14:06:03.941 7 ERROR nova.virt.libvirt.driver [-] [instance: c268b00f-e1b3-437d-a931-0cfd5bb577cf] Migration operation has aborted
98:2020-06-07 14:06:42.202 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:41.622501Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
99:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:06:41.622501Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
100:2020-06-07 14:06:42.228 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Migration operation has aborted
110:2020-06-07 14:07:52.667 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:07:52.082569Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
111:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:07:52.082569Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
112:2020-06-07 14:07:52.671 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Migration operation has aborted
126:2020-06-07 14:10:34.276 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Live Migration failure: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:10:33.626617Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
127:qemu-kvm: /builddir/build/BUILD/qemu-4.2.0/target/i386/kvm.c:2695: kvm_buf_set_msrs: Assertion `ret == cpu->kvm_msr_buf->nmsrs' failed.: libvirt.libvirtError: internal error: qemu unexpectedly closed the monitor: 2020-06-07T11:10:33.626617Z qemu-kvm: error: failed to set MSR 0x48e to 0xfff9fffe04006172
128:2020-06-07 14:10:34.654 7 ERROR nova.virt.libvirt.driver [-] [instance: c7b46c98-30e5-4edd-a31c-1b368dfd11a4] Migration operation has aborted
144:2020-06-07 15:33:51.054 7 INFO nova.compute.manager [-] [instance: 6d3ee2a2-6984-4a01-a406-4634e2ae6d2b] VM Stopped (Lifecycle Event)
  • Stopping and rebooting the instances would also generate those errors.

Environment

  • Red Hat OpenStack Platform 15.0 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content