[RHOSO 18] - ovn-controller-ovs pods fail to start after applying Octavia nicMappings

Issue

• After updating OpenStackControlPlane CR and adding the nicMappings to enable the Octavia the ovn-controller-ovs pods fail to start properly.

$ oc edit oscp/openstack-control-plane
[...]
  ovn: 
    enabled: true
    template:
      ovnController:
        networkAttachment: tenant
        nicMappings:
          datacentre: enp3s0
          octavia: octbr    #<<<<ADDED

$ oc get pods -l service=ovn-controller-ovs
NAME                       READY   STATUS     RESTARTS   AGE
ovn-controller-ovs-fjlk5   0/2     Init:0/1   0          63s
ovn-controller-ovs-s2899   0/2     Init:0/1   0          63s
ovn-controller-ovs-x2jlj   0/2     Init:0/1   0          63s

$ oc describe pod/ovn-controller-ovs-fjlk5
[...]
  Warning  FailedCreatePodSandBox  11s                kubelet  Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ovn-controller-ovs-fjlk5_openstack_e6e8f7a1-7e4e-4cf3-9c6e-bfa65532579e_0(be16383c152e80963e2acf2405a578d2cfd859e9ae5f49bc99525ecb18c94d25): error adding pod openstack_ovn-controller-ovs-fjlk5 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"be16383c152e80963e2acf2405a578d2cfd859e9ae5f49bc99525ecb18c94d25" Netns:"/var/run/netns/4208dcf3-a7bb-48d3-b62a-b4aed6411284" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack;K8S_POD_NAME=ovn-controller-ovs-fjlk5;K8S_POD_INFRA_CONTAINER_ID=be16383c152e80963e2acf2405a578d2cfd859e9ae5f49bc99525ecb18c94d25;K8S_POD_UID=e6e8f7a1-7e4e-4cf3-9c6e-bfa65532579e" Path:"" ERRORED: error configuring pod [openstack/ovn-controller-ovs-fjlk5] networking: [openstack/ovn-controller-ovs-fjlk5/e6e8f7a1-7e4e-4cf3-9c6e-bfa65532579e:octavia]: error adding container to network "octavia": failed to add route '{192.1.2.0 ffff0000} via 192.0.2.150 dev octavia': invalid argument

OR may see this error:

  Warning  FailedCreatePodSandBox  2m43s (x57 over 15m)  kubelet  (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_ovn-controller-ovs-5rjnm_openstack_68204fb3-394d-4990-80d3-fc2e388c2ee3_0(4eddc6890d77f41256a473b0fc2337cca77bf370d22beebc55b55582bb82d059): error adding pod openstack_ovn-controller-ovs-5rjnm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4eddc6890d77f41256a473b0fc2337cca77bf370d22beebc55b55582bb82d059" Netns:"/var/run/netns/28a94a1c-6cad-444e-9372-1ead721fa87b" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack;K8S_POD_NAME=ovn-controller-ovs-5rjnm;K8S_POD_INFRA_CONTAINER_ID=4eddc6890d77f41256a473b0fc2337cca77bf370d22beebc55b55582bb82d059;K8S_POD_UID=68204fb3-394d-4990-80d3-fc2e388c2ee3" Path:"" ERRORED: error configuring pod [openstack/ovn-controller-ovs-5rjnm] networking: [openstack/ovn-controller-ovs-5rjnm/68204fb3-394d-4990-80d3-fc2e388c2ee3:octavia]: error adding container to network "octavia": failed to move link invalid argument