Promotheus probe fails with "Unexpected exception in API method" error while probing in RHOSP.

Solution Verified - Updated -

Issue

  • Promotheus probe fails with Unexpected exception in API method error while probing in RHOSP.
  • The probing constantly fails with below exception seen in the nova-api.log:
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions [req-9fadf22c-e668-4ba4-97e0-611b43b124b7 79c4bb8e76424319bcd1fc85c7850df8 97d07ed175b846f7840c9c24f9f7867d - default default] Unexpected exception in API method
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 338, in wrapped
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/floating_ips.py", line 141, in index
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions     floating_ips = self.network_api.get_floating_ips_by_project(context)
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1866, in get_floating_ips_by_project
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions     for fip in fips]
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1823, in _make_floating_ip_obj
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions     pool = pool_dict[fip['floating_network_id']]
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions KeyError: u'NULL'
2019-08-30 17:02:53.917 87248 ERROR nova.api.openstack.extensions 
2019-08-30 17:02:53.919 87248 INFO nova.api.openstack.wsgi [req-9fadf22c-e668-4ba4-97e0-611b43b124b7 79c4bb8e76424319bcd1fc85c7850df8 97d07ed175b846f7840c9c24f9f7867d - default default] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.KeyError'>

Environment

  • Red Hat OpenStack Platform (RHOSP).
  • Prometheus monitoring.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content