Chapter 3. Upgrading the Storage Cluster

1. Remove existing Ceph repositories:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf Calamari.list Installer.list Tools.list

2. Remove existing cephdeploy.conf file from the Ceph working directory:

   Syntax

   # rm -rf <directory>/cephdeploy.conf

   Example

   # rm -rf /home/example/ceph/cephdeploy.conf

3. Remove existing .cephdeploy.conf file from the home directory:

   Syntax

   $ rm -rf <directory>/.cephdeploy.conf

   Example

   # rm -rf /home/example/ceph/.cephdeploy.conf

4. Set the Installer (ceph-deploy) repository then use ceph-deploy to enable the Calamari and Tools repositories.:

   $ sudo bash -c 'umask 0077; echo deb https://customername:customerpasswd@rhcs.download.redhat.com/ubuntu/1.3-updates/Installer $(lsb_release -sc) main | tee /etc/apt/sources.list.d/Installer.list'
   $ sudo bash -c 'wget -O - https://www.redhat.com/security/fd431d51.txt | apt-key add -'
   $ sudo apt-get update
   $ sudo apt-get install ceph-deploy
   $ ceph-deploy repo --repo-url 'https://customername:customerpasswd@rhcs.download.redhat.com/ubuntu/1.3-updates/Calamari' Calamari `hostname -f`
   $ ceph-deploy repo --repo-url 'https://customername:customerpasswd@rhcs.download.redhat.com/ubuntu/1.3-updates/Tools' Tools `hostname -f`
   $ sudo apt-get update

5. Upgrade Calamari:

   $ sudo apt-get install calamari-server calamari-clients

6. Re-initialize Calamari:

   $ sudo calamari-ctl initialize

7. Update existing cluster nodes that report to Calamari:

   $ sudo salt '*' state.highstate

8. Upgrade Ceph:

   $ ceph-deploy install --no-adjust-repos --cli  <admin-node>
   $ sudo apt-get upgrade
   $ sudo restart ceph-all

1. Remove existing Ceph repositories:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf Calamari.list Installer.list Tools.list

2. Remove existing cephdeploy.conf file from the Ceph working directory:

   Syntax

   $ rm -rf <directory>/cephdeploy.conf

   Example

   $ rm -rf /home/example/ceph/cephdeploy.conf

3. Remove existing .cephdeploy.conf file from the home directory:

   Syntax

   $ rm -rf <directory>/.cephdeploy.conf

   Example

   $ rm -rf /home/example/ceph/.cephdeploy.conf

4. Visit the Red Hat Customer Portal to obtain the Red Hat Ceph Storage ISO image file.
5. Download rhceph-1.3.3-ubuntu-x86_64-dvd.iso file.

6. Using sudo, mount the image:

   $ sudo mount /<path_to_iso>/rhceph-1.3.3-ubuntu-x86_64-dvd.iso /mnt

7. Using sudo, install the setup program:

   $ sudo dpkg -i /mnt/ice-setup_*.deb

   Note

   if you receive an error about missing python-pkg-resources, run sudo apt-get -f install to install the missing python-pkg-resources dependency.

8. Navigate to the working directory:

   $ cd ~/ceph-config

9. Using sudo, run the setup script in the working directory:

   $ sudo ice_setup -d /mnt

   The ice_setup program will install upgraded version of ceph-deploy, calamari-server, calamari-clients, create new local repositories and a .cephdeploy.conf file.

10. Initialize Calamari and update existing cluster nodes that report to Calamari:

    $ sudo calamari-ctl initialize
    $ sudo salt '*' state.highstate

11. Upgrade Ceph:

    $ ceph-deploy install --no-adjust-repos --cli <admin-node>
    $ sudo apt-get upgrade
    $ sudo restart ceph-all

Online Repository

1. Remove existing Ceph repositories in Monitor node:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf ceph-mon.list

2. Set online Monitor repository in Monitor node from admin node:

   $ ceph-deploy repo --repo-url 'https://customername:customerpasswd@rhcs.download.redhat.com/ubuntu/1.3-updates/MON' --gpg-url https://www.redhat.com/security/fd431d51.txt ceph-mon <monitor-node>

3. Reinstall Ceph in Monitor node from the admin node:

   $ ceph-deploy install --no-adjust-repos --mon <monitor-node>

   Note

   You need to specify --no-adjust-repos with ceph-deploy so that ceph-deploy does not create ceph.list file on Monitor node.

4. Reconnect the Monitor node to Calamari. From the admin node, execute:

   $ ceph-deploy calamari connect --master '<FQDN for the Calamari admin node>' <monitor-node>

5. Upgrade and restart the Ceph Monitor daemon. From the Monitor node, execute:

   $ sudo apt-get update
   $ sudo apt-get upgrade
   $ sudo restart ceph-mon id={hostname}

1. Execute on the Monitor node:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf ceph-mon.list

2. From the administration node, execute:

   $ ceph-deploy repo ceph-mon <monitor-node>
   $ ceph-deploy install --no-adjust-repos --mon <monitor-node>

3. Reconnect the Monitor node to Calamari. From the administration node, execute:

   $ ceph-deploy calamari connect --master '<FQDN for the Calamari admin node>' <monitor-node>

4. Upgrade and restart Ceph Monitor daemon. From the Monitor node, execute:

   $ sudo apt-get update
   $ sudo apt-get upgrade
   $ sudo restart ceph-mon id={hostname}

Using the Online Repositories

1. Remove existing Ceph repositories in the OSD node:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf ceph-osd.list

2. Set online OSD repository on OSD node from administration node:

   $ ceph-deploy repo --repo-url 'https://customername:customerpasswd@rhcs.download.redhat.com/ubuntu/1.3-updates/OSD' --gpg-url https://www.redhat.com/security/fd431d51.txt ceph-osd <osd-node>

3. Reinstall Ceph on OSD node from the administration node:

   $ ceph-deploy install --no-adjust-repos --osd <osd-node>

   Note

   You need to specify --no-adjust-repos with ceph-deploy so that ceph-deploy does not create ceph.list file on OSD node.

4. Reconnect the OSD node to Calamari. From the administration node, execute:

   $ ceph-deploy calamari connect --master '<FQDN for the Calamari admin node>' <osd-node>

5. Update and restart the Ceph OSD daemon. From the OSD node, execute:

   $ sudo apt-get update
   $ sudo apt-get upgrade
   $ sudo restart ceph-osd id={id}

1. Execute on the OSD node:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf ceph-osd.list

2. From the administration node, execute:

   $ ceph-deploy repo ceph-osd <osd-node>
   $ ceph-deploy install --no-adjust-repos --osd <osd-node>

3. Reconnect the OSD node to Calamari. From the administration node, execute:

   $ ceph-deploy calamari connect --master '<FQDN_Calamari_admin_node>' <osd-node>

4. Upgrade and restart the Ceph OSD daemon. From the OSD node, execute:

   $ sudo apt-get update
   $ sudo apt-get upgrade
   $ sudo restart ceph-osd id=<id>

Using the Online Repositories

1. Remove existing Ceph repository on the Object Gateway node:

   $ cd /etc/apt/sources.list.d/

   $ sudo rm -rf ceph-mon.list

   OR

   $ sudo rm -rf ceph-osd.list

   Note

   For Red Hat Ceph Storage v1.3.1, you had to install either ceph-mon or ceph-osd repository for the radosgw package. Remove the repository that was previous installed before setting the Tools repository for Red Hat Ceph Storage v1.3.3.

   If upgrading from Red Hat Ceph Storage 1.3.2, then this step can be skipped.

2. Set the online Tools repository from administration node:

   $ ceph-deploy repo --repo-url 'https://customername:customerpasswd@rhcs.download.redhat.com/ubuntu/1.3-updates/Tools' --gpg-url https://www.redhat.com/security/fd431d51.txt Tools <rgw-node>

3. Reinstall Object Gateway from the administration node:

   $ ceph-deploy install --no-adjust-repos --rgw <rgw-node>

4. For federated deployments, from the Object Gateway node, execute:

   $ sudo apt-get install radosgw-agent

5. Upgrade and restart the Object Gateway:

   $ sudo apt-get update
   $ sudo apt-get upgrade
   $ sudo service radosgw restart id=rgw.<short-hostname>

   Note

   If you modify the ceph.conf file for radosgw to run on port 80 then run sudo service apache2 stop before restarting the gateway.

1. Remove existing Ceph repository in the Ceph Object Gateway node:

   $ cd /etc/apt/sources.list.d/
   $ sudo rm -rf ceph.list

2. Stop Apache/Radosgw:

   $ sudo service apache2 stop
   $ sudo /etc/init.d/radosgw stop

3. From the administration node, execute:

   $ ceph-deploy repo ceph-mon <rgw-node>
   $ ceph-deploy install --no-adjust-repos --rgw <rgw-node>

   Note

   Both ceph-mon and ceph-osd repository contains the radosgw package. So, you can use anyone of them for the Object Gateway upgrade.

4. For federated deployments, from the Ceph Object Gateway node, execute:

   $ sudo apt-get install radosgw-agent

5. Finally, from the Ceph Object Gateway node, restart the gateway:

   $ sudo service radosgw restart

1. Remove existing Ceph repository in the Ceph Object Gateway node:

   $ cd /etc/apt/sources.list.d/

   $ sudo rm -rf ceph-mon.list

   OR

   $ sudo rm -rf ceph-osd.list

   Note

   For Red Hat Ceph Storage v1.3.1, you had to install either ceph-mon or ceph-osd repository for the radosgw package. You have to remove the repository that was previous installed before setting the new repo for RHCS v1.3.2.

2. From the administration node, execute:

   $ ceph-deploy repo ceph-mon <rgw-node>
   $ ceph-deploy install --no-adjust-repos --rgw <rgw-node>

   Note

   Both ceph-mon and ceph-osd repo contains the radosgw package. So, you can use anyone of them for the gateway upgrade.

3. For federated deployments, from the Object Gateway node, execute:

   $ sudo apt-get install radosgw-agent

4. Upgrade and restart the Object Gateway:

   $ sudo apt-get update
   $ sudo apt-get upgrade
   $ sudo service radosgw restart id=rgw.<short-hostname>

   Note

   If you modify the ceph.conf file for radosgw to run on port 80 then run sudo service apache2 stop before restarting the gateway.