Can't launch any instances after new OSP10 Install

Solution Unverified - Updated -

Issue

  • Unable to launch instances, observe errors in nova-compute.log:
2017-01-19 14:45:17.800 745011 ERROR nova.compute.manager MessagingTimeout: Timed out waiting for a reply to message ID <uuid>
  • There are corresponding errors in nova-conductor.log:
2017-01-19 15:22:29.666 728782 WARNING oslo_messaging._drivers.amqpdriver [req-797c738d-0219-4686-9d95-ff41545498b2 - - - - -] reply_<id> doesn't exists, drop reply to <uuid>
2017-01-19 15:22:29.667 728782 INFO oslo_messaging._drivers.amqpdriver [req-797c738d-0219-4686-9d95-ff41545498b2 - - - - -] The reply <uuid> cannot be sent  reply_<id> reply queue don't exist after 60 sec abandoning...
  • Errors and failure continue despite restarting nova-conductor service
  • One of the controllers is not in the rabbitmq cluster:
From controller-0:

[root@overcloud-controller-0 ~]# rabbitmqctl cluster_status
Cluster status of node 'rabbit@overcloud-controller-0' ...
[{nodes,[{disc,['rabbit@overcloud-controller-0',
                'rabbit@overcloud-controller-2']}]},
 {running_nodes,['rabbit@overcloud-controller-2',
                 'rabbit@overcloud-controller-0']},
 {cluster_name,<<"rabbit@overcloud-controller-2.localdomain">>},
 {partitions,[]},
 {alarms,[{'rabbit@overcloud-controller-2',[]},
          {'rabbit@overcloud-controller-0',[]}]}]

From controller-1:

[root@overcloud-controller-1 ~]# rabbitmqctl cluster_status
Cluster status of node 'rabbit@overcloud-controller-1' ...
[{nodes,[{disc,['rabbit@overcloud-controller-1']}]},
 {running_nodes,['rabbit@overcloud-controller-1']},
 {cluster_name,<<"rabbit@overcloud-controller-1.localdomain">>},
 {partitions,[]},
 {alarms,[{'rabbit@overcloud-controller-1',[]}]}]

Environment

  • Red Hat OpenStack Platform 10.0

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.