Octavia stuck in "Pending Create"

Issue

• We are having a problem when trying to create the loadbalancer, it remains in the "Pending Create" status. When looking at the logs, the amphora VMs are created, but the Octavia Worker is unable to reach them as seen in the following log:

2023-10-04 14:37:35.408 110 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='10.10.10.10', port=9443): Max retries exceeded with url: // (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7f00f8ac1828>, 'Connection to 10.10.10.10 timed out. (connect timeout=10.0)'))
2023-10-04 14:37:35.515 110 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='10.10.10.10', port=9443): Max retries exceeded with url: // (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7f00f8ac1438>, 'Connection to 10.10.10.10 timed out. (connect timeout=10.0)'))

• However, this only occurs on the controller that is the creating loadbalancer Worker as the other two controllers reach these VMs.

• We see the packets on o-hm0 from port 5555 and 9443 but not on genev_sys_6081.