RHCS 3- DataNodes configuration with different labels using ansible

Latest response

Current ansible version,
[root@mon1-ceph-eaa .ssh]# rpm -qa|grep -i ansible
ceph-ansible-3.0.33-1.el7cp.noarch
ansible-2.4.4.0-1.el7ae.noarch
[root@mon1-ceph-eaa .ssh]#

As shown below the disk label is different on different data nodes -

Below on DN11 - the first OSD disk label is 'sdc' and for DN13 its 'sdb'

Note: MB6000GVYZB --> are SATA disks used for OSD's
MO000800JWFWP --> SSD disks used for hosting the OSD journals
[root@dn11-ceph-eaa ~]# lsscsi -s
[7:0:0:0] disk ATA MB6000GVYZB HPG3 /dev/sdc 6.00TB
[7:0:1:0] disk ATA MB6000GVYZB HPG3 /dev/sde 6.00TB
[7:0:2:0] disk ATA MB6000GVYZB HPG3 /dev/sdf 6.00TB
[7:0:3:0] disk ATA MB6000GVYZB HPG3 /dev/sdg 6.00TB
[7:0:4:0] disk ATA MB6000GVYZB HPG3 /dev/sdh 6.00TB
[7:0:5:0] disk ATA MB6000GVYZB HPG3 /dev/sdi 6.00TB
[7:0:6:0] disk ATA MB6000GVYZB HPG3 /dev/sdj 6.00TB
[7:0:7:0] disk ATA MB6000GVYZB HPG3 /dev/sdk 6.00TB
[7:0:8:0] disk ATA MB6000GVYZB HPG3 /dev/sdl 6.00TB
[7:0:9:0] disk ATA MB6000GVYZB HPG3 /dev/sdm 6.00TB
[7:0:10:0] disk ATA MB6000GVYZB HPG3 /dev/sdn 6.00TB
[7:0:11:0] disk ATA MB6000GVYZB HPG3 /dev/sdo 6.00TB
[7:0:12:0] disk HP MO000800JWFWP HPD2 /dev/sdp 800GB
[7:0:13:0] disk HP MO000800JWFWP HPD2 /dev/sdq 800GB
[root@dn11-ceph-eaa ~]#

[root@dn13-ceph-eaa ~]# lsscsi -s
[7:0:0:0] disk ATA MB6000GVYZB HPG3 /dev/sdb 6.00TB
[7:0:1:0] disk ATA MB6000GVYZB HPG3 /dev/sde 6.00TB
[7:0:2:0] disk ATA MB6000GVYZB HPG3 /dev/sdf 6.00TB
[7:0:3:0] disk ATA MB6000GVYZB HPG3 /dev/sdg 6.00TB
[7:0:4:0] disk ATA MB6000GVYZB HPG3 /dev/sdh 6.00TB
[7:0:5:0] disk ATA MB6000GVYZB HPG3 /dev/sdi 6.00TB
[7:0:6:0] disk ATA MB6000GVYZB HPG3 /dev/sdj 6.00TB
[7:0:7:0] disk ATA MB6000GVYZB HPG3 /dev/sdk 6.00TB
[7:0:8:0] disk ATA MB6000GVYZB HPG3 /dev/sdl 6.00TB
[7:0:9:0] disk ATA MB6000GVYZB HPG3 /dev/sdm 6.00TB
[7:0:10:0] disk ATA MB6000GVYZB HPG3 /dev/sdn 6.00TB
[7:0:11:0] disk ATA MB6000GVYZB HPG3 /dev/sdo 6.00TB
[7:0:12:0] disk HP MO000800JWFWP HPD2 /dev/sdp 800GB
[7:0:13:0] disk HP MO000800JWFWP HPD2 /dev/sdq 800GB

Given the different disk configuration, how to define the osds.yml to consider the OSD and SSD configuration.

We have already created a cluster, how can we edit the osds.yml and consider new datanode addition with different labels withour impacting the current cluster status.

Responses

As root, modify the existing /etc/ansible/hosts file. Under the [osds] section, add the new OSD node name, and using the devices and raw_journal_devices settings, specify the different disk topology

for Ex :

osds] ... osdnode10 devices="['/dev/sdc', '/dev/sdd', '/dev/sde', '/dev/sdf']" raw_journal_devices="['/dev/sda', '/dev/sda', '/dev/sdb', '/dev/sdb']"