Old VXLAN tunnel endpoints persist after node deletion in Red Hat OpenStack Platform

Issue

Old VXLAN tunnel endpoints persist after node deletion in Red Hat OpenStack Platform.

ovs-vsctl show shows tunnel endpoints to invalid IP addresses and the ARP table shows IP addresses with incomplete ARP resolution:

[root@compute01 ~]# arp -n | grep 192.168.3 | grep incom
192.168.3.172                    (incomplete)                              vlan666
192.168.3.183                    (incomplete)                              vlan666
192.168.3.173                    (incomplete)                              vlan666

Additionally, one can observe a small storm or ARP packets on the tenant network due to the fact that all overcloud nodes try to resolve these invalid IP addresses.

The ovs_neutron database still holds entries for these endpoints:

[root@srbhonciye24 ~]# mysql ovs_neutron -e 'select * from ml2_vxlan_endpoints' | egrep '183|173|172'
192.168.3.172   4789    compute62.localdomain
192.168.3.173   4789    compute63.localdomain
192.168.3.183   4789    compute73.localdomain

These nodes were deleted at an earlier point in time.