Cinder Service Unavailable (HTTP 503) LockCreationFailed: Coordinator uninitialized

Solution In Progress - Updated -

Issue

  • All Cinder volume creation/deletion started failing with error Service Unavailable (HTTP 503).

  • We also found the following error message:

2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server [req-fe125062-19cd-48b1-bfea-74931118fb53 31613c8dcf014fb8be7c047dfc9d73c2 7bcafc9722684dad950897d1a7ff469a - default default] Exception during message handling: cinder.exception.LockCreationFailed: Coordinator uninitialized.
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server   File "<decorator-gen-236>", line 2, in delete_volume
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.6/site-packages/cinder/coordination.py", line 140, in _synchronized
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server     lock = coordinator.get_lock(lock_name.format(**call_args))
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.6/site-packages/cinder/coordination.py", line 88, in get_lock
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server     raise exception.LockCreationFailed(_('Coordinator uninitialized.'))
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server cinder.exception.LockCreationFailed: Coordinator uninitialized.
2024-02-21 16:05:18.128 75 ERROR oslo_messaging.rpc.server 
  • Issue was resolved after running pcs resource restart openstack-cinder-volume and waiting for about 15min.

Environment

  • Red Hat OpenStack Platform 16.2 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content