APIC Driver Integration Issue

Issue

• Experiencing errors from APIC neutron driver and we are unable to create VM's. These are the errors seen in the logs:

2015-07-31 16:22:33.819 90337 ERROR neutron.plugins.ml2.managers [req-1eb1fc53-02ca-4c9b-bb0a-b2dcfb2b4466 None] Mechanism driver 'cisco_apic' failed in update_port_postcommit
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/managers.py", line 291, in _call_on_drivers
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/cisco/apic/mechanism_apic.py", line 81, in inner
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     return f(inst, *args, **kwargs)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/cisco/apic/mechanism_apic.py", line 201, in update_port_postcommit
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     self._perform_port_operations(context)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/cisco/apic/mechanism_apic.py", line 146, in _perform_port_operations
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     self._perform_path_port_operations(context, port)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/site-packages/neutron/openstack/common/lockutils.py", line 249, in inner
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     return f(*args, **kwargs)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/cisco/apic/mechanism_apic.py", line 106, in _perform_path_port_operations
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     tenant_id, anetwork_id, host, seg, transaction=trs)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers   File "build/bdist.linux-x86_64/egg/apicapi/apic_manager.py", line 822, in ensure_path_created_for_port
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers     raise cexc.ApicHostNotConfigured(host=host_id)
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers ApicHostNotConfigured: The switch and port for host 'neutron-n-1' are not configured
2015-07-31 16:22:33.819 90337 TRACE neutron.plugins.ml2.managers

2015-07-31 15:57:32.257 24962 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager Traceback (most recent call last):
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1688, in _allocate_network_async
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     dhcp_options=dhcp_options)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 443, in allocate_for_instance
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     self._delete_ports(neutron, instance, created_port_ids)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     six.reraise(self.type_, self.value, self.tb)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 423, in allocate_for_instance
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     security_group_ids, available_macs, dhcp_opts)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 236, in _create_port
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     network_id, instance=instance)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     six.reraise(self.type_, self.value, self.tb)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 214, in _create_port
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     port_id = port_client.create_port(port_req_body)['port']['id']
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/__init__.py", line 84, in wrapper
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     ret = obj(*args, **kwargs)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 98, in with_params
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     ret = self.function(instance, *args, **kwargs)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 322, in create_port
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     return self.post(self.ports_path, body=body)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/__init__.py", line 84, in wrapper
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     ret = obj(*args, **kwargs)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 1325, in post
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     headers=headers, params=params)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/__init__.py", line 84, in wrapper
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     ret = obj(*args, **kwargs)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 1251, in do_request
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     self._handle_fault_response(status_code, replybody)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/__init__.py", line 84, in wrapper
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     ret = obj(*args, **kwargs)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 1216, in _handle_fault_response
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager     exception_handler_v20(status_code, des_error_body)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager   File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 66, in exception_handler_v20

2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager status_code=status_code)
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager InternalServerError: update_port_postcommit failed.
2015-07-31 15:57:32.257 24962 TRACE nova.compute.manager