Cinder API not starting after OSP10 upgrade

Solution Verified - Updated -

Issue

  • While upgrading from OSP9 to OSP10, the openstack-cinder-api service is not starting on all 3 controllers.
  • Error in the /var/log/cinder/api.log:
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
2017-10-21 19:05:42.151 40222 ERROR cinder     return context.create()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
2017-10-21 19:05:42.151 40222 ERROR cinder     return self.object_type.invoke(self)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 144, in invoke
2017-10-21 19:05:42.151 40222 ERROR cinder     **context.local_conf)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
2017-10-21 19:05:42.151 40222 ERROR cinder     val = callable(*args, **kw)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/__init__.py", line 34, in root_app_factory
2017-10-21 19:05:42.151 40222 ERROR cinder     return paste.urlmap.urlmap_factory(loader, global_conf, **local_conf)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/urlmap.py", line 25, in urlmap_factory
2017-10-21 19:05:42.151 40222 ERROR cinder     app = loader.get_app(app_name, global_conf=global_conf)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 350, in get_app
2017-10-21 19:05:42.151 40222 ERROR cinder     name=name, global_conf=global_conf).create()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
2017-10-21 19:05:42.151 40222 ERROR cinder     return self.object_type.invoke(self)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 144, in invoke
2017-10-21 19:05:42.151 40222 ERROR cinder     **context.local_conf)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
2017-10-21 19:05:42.151 40222 ERROR cinder     val = callable(*args, **kw)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/middleware/auth.py", line 56, in pipeline_factory
2017-10-21 19:05:42.151 40222 ERROR cinder     app = loader.get_app(pipeline[-1])
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 350, in get_app
2017-10-21 19:05:42.151 40222 ERROR cinder     name=name, global_conf=global_conf).create()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
2017-10-21 19:05:42.151 40222 ERROR cinder     return self.object_type.invoke(self)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 146, in invoke
2017-10-21 19:05:42.151 40222 ERROR cinder     return fix_call(context.object, context.global_conf, **context.local_conf)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
2017-10-21 19:05:42.151 40222 ERROR cinder     val = callable(*args, **kw)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/openstack/__init__.py", line 72, in factory
2017-10-21 19:05:42.151 40222 ERROR cinder     return cls()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/openstack/__init__.py", line 84, in __init__
2017-10-21 19:05:42.151 40222 ERROR cinder     self._setup_ext_routes(mapper, ext_mgr)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/openstack/__init__.py", line 89, in _setup_ext_routes
2017-10-21 19:05:42.151 40222 ERROR cinder     for resource in ext_mgr.get_resources():
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/extensions.py", line 156, in get_resources
2017-10-21 19:05:42.151 40222 ERROR cinder     resources.extend(ext.get_resources())
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/contrib/backups.py", line 261, in get_resources
2017-10-21 19:05:42.151 40222 ERROR cinder     Backups.alias, BackupsController(),
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/api/contrib/backups.py", line 42, in __init__
2017-10-21 19:05:42.151 40222 ERROR cinder     self.backup_api = backupAPI.API()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/backup/api.py", line 72, in __init__
2017-10-21 19:05:42.151 40222 ERROR cinder     self.backup_rpcapi = backup_rpcapi.BackupAPI()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/rpc.py", line 194, in __init__
2017-10-21 19:05:42.151 40222 ERROR cinder     obj_version_cap = self.determine_obj_version_cap()
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/rpc.py", line 233, in determine_obj_version_cap
2017-10-21 19:05:42.151 40222 ERROR cinder     cinder.context.get_admin_context(), cls.BINARY)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 188, in get_minimum_obj_version
2017-10-21 19:05:42.151 40222 ERROR cinder     binary)
2017-10-21 19:05:42.151 40222 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/objects/service.py", line 173, in _get_minimum_version
2017-10-21 19:05:42.151 40222 ERROR cinder     raise exception.ServiceTooOld(msg)
2017-10-21 19:05:42.151 40222 ERROR cinder ServiceTooOld: One of the services is in Liberty version. We do not provide backward compatibility with Liberty now, you need to upgrade to Mitaka first.
2017-10-21 19:05:42.151 40222 ERROR cinder

Environment

  • Red Hat OpenStack Platform 9
  • Red Hat OpenStack Platform 10

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content