Appendix A. Comparison between Ceph Ansible and Cephadm

The Red Hat Ceph Storage 5 introduces a new deployment tool, Cephadm, for the containerized deployment of the storage cluster.

The tables compare Cephadm with Ceph-Ansible playbooks for managing the containerized deployment of a Ceph cluster for day one and day two operations.

Table A.1. Day one operations

DescriptionCeph-AnsibleCephadm

Installation of the Red Hat Ceph Storage cluster

Run the site-container.yml playbook.

Run cephadm bootstrap command to bootstrap the cluster on the admin node.

Addition of hosts

Use the Ceph Ansible inventory.

Run ceph orch host add HOST_NAME to add hosts to the cluster.

Addition of monitors

Run the add-mon.yml playbook.

Run the ceph orch apply mon command.

Addition of managers

Run the site-container.yml playbook.

Run the ceph orch apply mgr command.

Addition of OSDs

Run the add-osd.yml playbook.

Run the ceph orch apply osd command to add OSDs on all available devices or on specific hosts.

Addition of OSDs on specific devices

Select the devices in the osd.yml file and then run the add-osd.yml playbook.

Select the paths filter under the data_devices in the osd.yml file and then run ceph orch apply -i FILE_NAME.yml command.

Addition of MDS

Run the site-container.yml playbook.

Run the ceph orch apply FILESYSTEM_NAME command to add MDS.

Addition of Ceph Object Gateway

Run the site-container.yml playbook.

Run the ceph orch apply rgw commands to add Ceph Object Gateway.

Table A.2. Day two operations

DescriptionCeph-AnsibleCephadm

Removing hosts

Use the Ansible inventory.

Run ceph orch host rm HOST_NAME to remove the hosts.

Removing monitors

Run the shrink-mon.yml playbook.

Run ceph orch apply mon to redeploy other monitors.

Removing managers

Run the shrink-mon.yml playbook.

Run ceph orch apply mgr to redeploy other managers.

Removing OSDs

Run the shrink-osd.yml playbook.

Run ceph orch osd rm OSD_ID to remove the OSDs.

Removing MDS

Run the shrink-mds.yml playbook.

Run ceph orch rm SERVICE_NAME to remove the specific service.

Exporting Ceph File System over NFS Protocol.

Not supported on Red Hat Ceph Storage 4.

Run ceph nfs export create command.

Deployment of Ceph Object Gateway

Run the site-container.yml playbook.

Run ceph orch apply rgw SERVICE_NAME to deploy Ceph Object Gateway service.

Removing Ceph Object Gateway

Run the shrink-rgw.yml playbook.

Run ceph orch rm SERVICE_NAME to remove the specific service.

Deployment of iSCSI gateways

Run the site-container.yml playbook.

Run ceph orch apply iscsi to deploy iSCSI gateway.

Block device mirroring

Run the site-container.yml playbook.

Run ceph orch apply rbd-mirror command.

Minor version upgrade of Red Hat Ceph Storage

Run the infrastructure-playbooks/rolling_update.yml playbook.

Run ceph orch upgrade start command.

Upgrading from Red Hat Ceph Storage 4 to Red Hat Ceph Storage 5

Run infrastructure-playbooks/rolling_update.yml playbook.

Upgrade using Cephadm is not supported.

Deployment of monitoring stack

Edit the all.yml file during installation.

Run the ceph orch apply -i FILE.yml after specifying the services.

Additional Resources