Unable to start instance - No valid host was found.

Issue

• Instance is not getting started.

[root@tas57ctrl ~(openstack_admin)]# nova list
+--------------------------------------+----------------+--------+------------+-------------+----------+
| ID                                   | Name           | Status | Task State | Power State | Networks |
+--------------------------------------+----------------+--------+------------+-------------+----------+
| aa465c1f-c104-47a8-9dbe-d339711c0b2a | test-instance  | ERROR  | spawning   | NOSTATE     |          |
| 14dd4d80-3dfe-43ac-885c-037aa577f8d6 | test-instance1 | ERROR  | spawning   | NOSTATE     |          |
+--------------------------------------+----------------+--------+------------+-------------+----------+

[root@tas57ctrl ~(openstack_admin)]# nova show 14dd4d80-3dfe-43ac-885c-037aa577f8d6
+--------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property                             | Value                                                                                                                                                                                                                           |
+--------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                                                                                                                                                                                                          |
| OS-EXT-AZ:availability_zone          | normal                                                                                                                                                                                                                          |
| OS-EXT-SRV-ATTR:host                 | test.example.com                                                                                                                                                                                               |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | test.example.com                                                                                                                                                                                               |
[...]
| OS-EXT-STS:vm_state                  | error                                                                                                                                                                                                                           |
[...]
| fault                                | {"message": "Build of instance 14dd4d80-3dfe-43ac-885c-037aa577f8d6 was re-scheduled: ", "code": 500, "details": "  File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2091, in _do_build_and_run_instance |
|                                      |     filter_properties)                                                                                                                                                                                                          |
|                                      |   File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 2222, in _build_and_run_instance                                                                                                                      |
|                                      |     instance_uuid=instance.uuid, reason=six.text_type(e))                                                                                                                                                                       |
|                                      | ", "created": "2015-12-16T11:03:38Z"}                                                                                                                                                                                           |
[...]
| status                               | ERROR                                                                                                                                                                                                                           |
| tenant_id                            | d8079acafd9842afa528718a208a74fa                                                                                                                                                                                                |
| updated                              | 2015-12-16T11:03:38Z                                                                                                                                                                                                            |
| user_id                              | 2463f977e62a4ecd94f01eee8dd4728a                                                                                                                                                                                                |
+--------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

compute logs:

2015-12-16 12:03:35.808 48533 DEBUG neutronclient.client [-] RESP:201 {'date': 'Wed, 16 Dec 2015 11:03:33 GMT', 'connection': 'keep-alive', 'content-type': 'application/json; charset=UTF-8',
 'content-length': '755', 'x-openstack-request-id': 'req-48b92272-0924-49ab-9965-7223bd2b6976'} {"port": {"status": "DOWN", "binding:host_id": "test.example.com", "allowed_a
ddress_pairs": [], "extra_dhcp_opts": [], "device_owner": "compute:nova", "binding:profile": {}, "fixed_ips": [{"subnet_id": "e9e93dd7-9fd2-4e76-b3a6-971ae0d8b562", "ip_address": "192.168.1.
13"}], "id": "6c68c8c2-cb7d-4c20-8512-12ae4457c7c3", "security_groups": ["b6fd339e-8e3f-4dbf-a721-7c7c44098ca2"], "device_id": "14dd4d80-3dfe-43ac-885c-037aa577f8d6", "name": "", "admin_stat
e_up": true, "network_id": "d1a4d33f-8bfa-4e45-89c3-4ccbb10a8425", "tenant_id": "d8079acafd9842afa528718a208a74fa", "binding:vif_details": {"port_filter": true, "ovs_hybrid_plug": true}, "bi
nding:vnic_type": "normal", "binding:vif_type": "ovs", "mac_address": "fa:16:3e:93:91:5b"}}

[...]

2015-12-16 12:03:35.811 48533 DEBUG nova.network.neutronv2.api [-] [instance: 14dd4d80-3dfe-43ac-885c-037aa577f8d6] Successfully created port: 6c68c8c2-cb7d-4c20-8512-12ae4457c7c3 _create_po
rt /usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py:298
2015-12-16 12:03:35.811 48533 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager Traceback (most recent call last):
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1704, in _allocate_network_async
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager     dhcp_options=dhcp_options)
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 529, in allocate_for_instance
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager     port_ids=ports_in_requested_order)
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/base_api.py", line 240, in get_instance_nw_info
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager     raise NotImplementedError()
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager NotImplementedError
2015-12-16 12:03:35.811 48533 TRACE nova.compute.manager 


2015-12-16 12:03:36.150 48533 DEBUG nova.compute.manager [-] Starting heal instance info cache _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5373
2015-12-16 12:03:36.150 48533 DEBUG nova.compute.manager [-] Rebuilding the list of instances to heal _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5377
2015-12-16 12:03:36.170 48533 DEBUG nova.compute.manager [-] [instance: 14dd4d80-3dfe-43ac-885c-037aa577f8d6] Skipping network cache update for instance because it is Building. _heal_instance_info_cache /usr/lib/python2.7/site-packages/nova/compute/manager.py:5387
2015-12-16 12:03:36.170 48533 DEBUG nova.objects.instance [-] Lazy-loading `system_metadata' on Instance uuid aa465c1f-c104-47a8-9dbe-d339711c0b2a obj_load_attr /usr/lib/python2.7/site-packages/nova/objects/instance.py:579
2015-12-16 12:03:36.269 48533 ERROR nova.compute.manager [-] [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a] An error occurred while refreshing the network cache.
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a] Traceback (most recent call last):
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 5432, in _heal_instance_info_cache
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]     self._get_instance_nw_info(context, instance, use_slave=True)
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1292, in _get_instance_nw_info
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]     instance)
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]   File "/usr/lib/python2.7/site-packages/nova/network/base_api.py", line 240, in get_instance_nw_info
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]     raise NotImplementedError()
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a] NotImplementedError
2015-12-16 12:03:36.269 48533 TRACE nova.compute.manager [instance: aa465c1f-c104-47a8-9dbe-d339711c0b2a]