Parallel Cloud Migration for Red Hat Enterprise Linux OpenStack Platform 6 (Juno)

Procedure 1. Upgrading the Controller Node

1. Deploy RHEL 7 controller nodes

   1. Deploy RHEL 7 onto a new set of servers, and restore your basic system configuration (interface definitions, storage attachments, etc) by installing some prerequisite packages:

      # yum install -y \
      openstack-selinux \
      openvswitch

   2. Activate the openvswitch service:

      # systemctl enable openvswitch
      # systemctl start openvswitch
      

   3. If you are using the LVM backend for Block Storage service, you will also need to install and activate the targetcli package for managing the LIO suybsystem:

      # yum -y install targetcli
      # systemctl enable target
      # systemctl start target
      

   4. Activate the LVM volume groups that contain your Block Storage volumes:

      # vgchange -ay

2. Restore the Network Configuration

   1. Ensure that you restore the /etc/sysconfig/network-scripts files required by your OpenStack Networking configuration, such as ifcfg-br-ex:

      # cp BACKUP/etc/sysconfig/network-scripts/ifcfg-br-ex \
      /etc/sysconfig/network-scripts/ifcfg-br-ex

   2. Activate the interfaces:

      # ifup br-ex

3. Restore iptables Rules

   1. Ensure that any local firewall configuration that was defined on your RHEL6 controller node is imported into the RHEL7 controller node by copying your RHEL 6 /etc/sysconfig/iptables into /etc/sysconfig/iptables on your RHEL 7 host.
   2. Install the iptables-services package:

      # yum install -y iptables-services

   3. Stop the iptables service:

      # systemctl stop iptables

   4. Restore your iptables configuration from backup:

      # cp BACKUP/etc/sysconfig/iptables /etc/sysconfig/iptables

   5. Activate the iptables service:

      # systemctl enable iptables
      # systemctl start iptables
      

4. Install rabbitmq-server

   1. Install the rabbitmq-server package:

      # yum install -y rabbitmq-server

   2. Migrate any rabbitmq configuration files from your RHEL6 controllers into /etc/rabbitmq on your RHEL7 controller:

      # rsync -a BACKUP/etc/rabbitmq/ /etc/rabbitmq

   3. Activate the rabbitmq-server service:

      # systemctl enable rabbitmq-server
      # systemctl start rabbitmq-server

5. Install mariadb-server

   1. Install the mariadb-server package:

      # yum install -y mariadb-server

   2. Either re-mount your /var/lib/mysql directory (and modify /etc/fstab appropriately), or restore the contents of /var/lib/mysql from your backups:

      # rsync -a BACKUP/var/lib/mysql/ /var/lib/mysql/

   3. Restore the /root/.my.conf file from your backups, if it exists:

      # cp BACKUP/root/.my.cnf /root/.my.cnf

   4. Ensure correct ownership of files in /var/lib/mysql:

      # chown -R mysql:mysql /var/lib/mysql
      # fixfiles restore /var/lib/mysql/
      

   5. Activate the mariadb service:

      # systemctl enable mariadb
      # systemctl start mariadb
      

   6. Perform any necessary database updates:

      # mysql_upgrade

      Verify that you are able to connect to the database server with the mysql command line client. A successful connection looks like this:

      # mysql
      Welcome to the MariaDB monitor.  Commands end with ; or \g.
      Your MariaDB connection id is 419
      Server version: 5.5.40-MariaDB MariaDB Server
      
      Copyright (c) 2000, 2014, Oracle, Monty Program Ab and others.
      
      Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
      
      MariaDB [(none)]> 
      

6. Install Identity service

   1. Install the openstack-keystone package:

      # yum install -y openstack-keystone

   2. Copy the Identity service configuration files from your RHEL6 controller into /etc/keystone on your RHEL7 controller:

      # rsync -a BACKUP/etc/keystone/ /etc/keystone/

   3. Upgrade the Identity service database schema:

      # sudo -u keystone keystone-manage db_sync

   4. Activate the Identity service:

      # systemctl enable openstack-keystone
      # systemctl start openstack-keystone

   5. Load your Identity service administrative credentials and verify that Identity is operating correctly:

      # . /root/keystonerc_admin
      # keystone endpoint-list

   Note

   The steps to follow assume that your Identity service credentials have been loaded into your environment.

7. Install Block Storage service

   1. Install the openstack-cinder package:

      # yum install -y openstack-cinder

   2. Copy the Block Storage configuration files from your RHEL6 controller into /etc/cinder on your RHEL7 controller:

      # rsync -a BACKUP/etc/cinder/ /etc/cinder/

      Note

      If you are using the LVM backend, you will need to update cinder.conf to use the new LIO driver. Edit the /etc/cinder/cinder.conf as follows:

      [DEFAULT]
      iscsi_helper=lioadm

   3. Upgrade the Block Storage database schema:

      # sudo -u cinder cinder-manage db sync

   4. Activate the Block Storage services:

      # systemctl enable openstack-cinder-{api,volume,scheduler}
      # systemctl start openstack-cinder-{api,volume,scheduler}
      

   5. Verify that the Block Storage API is responding correctly and that your volumes are available:

      # cinder list

8. Install Image service

   1. Install the openstack-glance package:

      # yum install -y openstack-glance

   2. Copy the Image service configuration files from your RHEL6 controller into /etc/glance on your RHEL7 controller:

      # rsync -a BACKUP/etc/glance/ /etc/glance/

   3. Upgrade the Image service database schema:

      # sudo -u glance glance-manage db sync

   4. Ensure the correct ownership on the Image service log and data directories:

      # chown -R glance:glance /var/lib/glance
      # fixfiles restore /var/lib/glance

   5. Activate the Image services:

      # systemctl enable openstack-glance-{api,registry}
      # systemctl start openstack-glance-{api,registry}
      

   6. Verify that the Image service is responding correctly:

      # glance image-list

9. Install OpenStack Networking

   1. Install the openstack-neutron package as well as packages for any OpenStack Networking plugins you are using (such as openstack-neutron-ml2 and openstack-neutron-openvswitch):

      # yum install -y openstack-neutron{,-ml2,-openvswitch}

   2. Copy the OpenStack Networking configuration files from your RHEL6 controller into /etc/neutron on the RHEL7 controller:

      # rsync -a BACKUP/etc/neutron/ /etc/neutron/

      Note

      Correct the permissions on these files, because the OpenStack Networking UID and GID on your system may be different.

      # find /etc/neutron \! -group root -exec chgrp neutron {} \;

   3. Upgrade the OpenStack Networking database schema:

      # neutron-db-manage --config-file /etc/neutron/neutron.conf \
      --config-file /etc/neutron/plugin.ini \
      upgrade head

   4. Activate the OpenStack Networking service:

      # systemctl enable neutron-{dhcp-agent,l3-agent,metadata-agent,openvswitch-agent,server}
      # systemctl start neutron-{dhcp-agent,l3-agent,metadata-agent,openvswitch-agent,server}

      You may need to activate additional Neutron agents to support things like LBaaS and VPNaaS.
   5. Verify that OpenStack Networking agents have started and are reporting properly:

      # neutron agent-list

      The output of this command should show the list of openvswitch agents on your compute hosts:

      +--------------------------------------+--------------------+------------------+-------+----------------+---------------------------+
      | id                                   | agent_type         | host             | alive | admin_state_up | binary                    |
      +--------------------------------------+--------------------+------------------+-------+----------------+---------------------------+
      .
      .
      .
      | 15736a0a-acc2-4227-b0e3-3bb720351870 | Open vSwitch agent | compute-1.local  | :-)   | True           | neutron-openvswitch-agent |
      | f87cc391-5263-4808-bf80-8b7d3caf8716 | Open vSwitch agent | compute-0.local  | :-)   | True           | neutron-openvswitch-agent |
      +--------------------------------------+--------------------+------------------+-------+----------------+---------------------------+
      

      These listings should show :-) in the alive column.

10. Install Compute

    1. Install the openstack-nova package:

       # yum install -y openstack-nova

    2. Copy the Compute configuration files from your RHEL6 controller into /etc/nova on your RHEL7 controller:

       # rsync -a BACKUP/etc/nova/ /etc/nova/

    3. Modify nova.conf to cap the Compute API at an Icehouse-compatible version by adding the following to the upgrade-levels section of the config file:

       [upgrade-levels]
       compute = 3.23.1
       conductor = 3.23.1

       Note

       This is necessary in order for your Juno controller to inter-operate with your Icehouse compute nodes.
    4. Upgrade the Compute database schema:

       # sudo -u nova nova-manage db sync

    5. Activate Compute services on your controller:

       # systemctl enable openstack-nova-{api,cert,conductor,consoleauth,novncproxy,scheduler}
       # systemctl start openstack-nova-{api,cert,conductor,consoleauth,novncproxy,scheduler}
       

    6. Verify that your Compute services have started correctly:

       # nova service-list

       You should see both the services on your controller as well as the nova-compute services running on your compute nodes:

       +----+------------------+------------------+----------+---------+-------+----------------------------+-----------------+
       | Id | Binary           | Host             | Zone     | Status  | State | Updated_at                 | Disabled Reason |
       +----+------------------+------------------+----------+---------+-------+----------------------------+-----------------+
       .
       .
       .
       | 5  | nova-compute     | compute-0.local  | nova     | enabled | up    | 2015-01-16T14:23:48.000000 | -               |
       | 6  | nova-compute     | compute-1.local  | nova     | enabled | up    | 2015-01-16T14:23:43.000000 | -               |
       +----+------------------+------------------+----------+---------+-------+----------------------------+-----------------+
       

       The nova-compute services should show up in the State column.

11. Install Dashboard

    1. Install the openstack-dashboard package:

       # yum install -y openstack-dashboard

    2. Copy the Dashboard configuration files from your RHEL6 controller to /etc/openstack-dashboard on your RHEL7 controller:

       # rsync -a BACKUP/etc/openstack-dashboard/ \
       /etc/openstack-dashboard/

       Note

       Enable the httpd_can_network_connect SELinux boolean:

       setsebool httpd_can_network_connect=true

    3. Activate the Apache service:

       # systemctl enable httpd
       # systemctl start httpd
       

Procedure 2. Upgrading the Compute Nodes

1. Migrate Compute Instances

   1. Migrate any running instances onto other compute nodes prior to reinstalling a compute node with RHEL7.
      If your environment supports live migration, you can use the nova live-migration command (as a user with administrative credentials):

      # nova live-migration SERVER_UUID

      This will move the instance to another available compute node.
      If your environment does not support live migration, you can use the nova migrate command:

      # nova migrate SERVER_UUID

      This will pause the virtual server and resume it on another available compute host.
   2. Servers will be in the CONFIRM_RESIZE state. For each server, run the resize-confirm command:

      # nova resize-confirm SERVER_UUID

      Note

      For the nova migrate command to work, the nova user on the source host must be able to connect using ssh to the nova user on the remote host.

      For more information on migrating instances, see https://access.redhat.com/articles/1265613.

2. Deploy a RHEL7 Compute Node

   1. Install some prerequisite packages:

      # yum install -y openstack-selinux \
      openvswitch \

   2. Activate the openvswitch and libvirtd services:

      # systemctl enable openvswitch
      # systemctl start openvswitch

3. Install Virtualization Support

   1. Install the libvirt and qemu-kvm packages:

      # yum install -y libvirt qemu-kvm

   2. Restore your libvirtd configuration from backups:

      # cp BACKUP/etc/libvirt/libvirtd.conf \
      /etc/libvirtd.conf

   3. Activate the libvirtd service:

      # systemctl enable libvirtd
      # systemctl start libvirtd

4. Restore iptables Rules

   1. Ensure that any local firewall configuration that was defined on your RHEL6 compute node is imported into the RHEL7 compute node.
   2. Install the iptables-services package:

      # yum install -y iptables -services

   3. Stop the iptables service:

      # systemctl stop iptables

   4. Restore your iptables configuration from backups:

      # cp BACKUP/etc/sysconfig/iptables /etc/sysconfig/iptables

   5. Activate the iptables service:

      # systemctl enable iptables
      # systemctl start iptables
      

5. Install OpenStack Networking

   1. Install the OpenStack Networking OpenVswitch agent:

      # yum install -y openstack-neutron-openvswitch

   2. Restore your OpenStack Networking configuration from your backups:

      # rsync -a BACKUP/etc/neutron/ /etc/neutron/

   3. Activate the OpenStack Networking services on the host:

      # systemctl enable neutron-openvswitch-agent neutron-ovs-cleanup
      # systemctl start neutron-openvswitch-agent
      

   4. On your controller, use the neutron agent-list command to verify that the agent on your compute node is reporting correctly.

6. Install Compute

   1. Install the openstack-nova-compute package:

      # yum install -y openstack-nova-compute

   2. Restore your Compute configuration from your backups:

      # rsync -a BACKUP/etc/nova

   3. Edit the nova.conf to cap the compute API at an Icehouse compatible version:

      [upgrade levels]
      compute = 3.23.1

      Note

      This is necessary in order for your Juno controller to inter-operate with your Icehouse compute nodes.
   4. Activate the Compute services on the compute host:

      # systemctl enable openstack-nova-compute
      # systemctl start openstack-nova-compute

   5. On your controller, use the nova service-list command to verify that the nova-compute service on your compute host is reporting correctly:

      # nova service-list