upgraded to the latest Openstack packages and getting a KVM segfault when instances are started.

Solution In Progress - Updated -

Issue

-We have installed RHOSP 16 with Ceph 4. Here is our environment:

1 – Director
3 – Controllers
29 – Computes
3 – Cephs
  • The deployment was successful and after an audit of the network and configuration it look as we had intended. However, when we create an instance, the instance crashes before the instance fully boots. We have tried various images and get the same result. In /var/log/messages, we do see a segfault for qemu-kvm around the same time the instance crashes but we have not found any information in the knowledge base or online with other people having the same experience.

  • We see these errors in /var/log/messages:

Mar 23 14:48:38 rhosp-compute-1 kernel: CPU 3/TCG[89217]: segfault at 28 ip 000055e5588fc13e sp 00007fa99b7fcd10 error 4 in qemu-kvm[55e5583d7000+a31000]
Mar 23 14:48:38 rhosp-compute-1 kernel: Code: 8b 87 e8 80 00 00 48 8b bf 48 81 00 00 48 8d 14 52 48 8d 1c d0 48 85 ff 74 03 48 8b 3f e8 ca f0 e8 ff 48 89 c7 e8 52 f1 e8 ff <8b> 4b 10 48 8b 3d c0 7f 9a 00 31 d2 48 89 c6 5b e9 ed f4 e3 ff 0f
...
Mar 23 14:48:38 rhosp-compute-1 systemd-coredump[89439]: Resource limits disable core dumping for process 88704 (qemu-kvm).
Mar 23 14:48:38 rhosp-compute-1 systemd-coredump[89439]: Process 88704 (qemu-kvm) of user 107 dumped core.
Mar 23 14:48:38 rhosp-compute-1 ovs-vswitchd[5914]: ovs|00279|dpdk|ERR|VHOST_CONFIG: recvmsg failed
Mar 23 14:48:38 rhosp-compute-1 ovs-vswitchd[5914]: ovs|00284|dpdk|ERR|VHOST_CONFIG: recvmsg failed
Mar 23 14:48:38 rhosp-compute-1 systemd-machined[52891]: Machine qemu-9-instance-0000000e terminated.
  • The overcloud deployment was successful but the instance creation failed. From what we can tell, here is what is happening:
-   Image file stored in Glance backended by Ceph is copied to the compute node
-   The DPDK ports are created and attached
-   The instance boots but during the boot process, the instance crashes with what appears to be from a segfault in qemu-kvm
-   Instance creation fails

Environment

  • Red Hat OpenStack Platform 16.0 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In