Troubles with shared storage with GFS2
Hi folks,
I'm attempting to create a two node active-active cluster for use with an application, and I'm having issues getting the shared storage working.
The cluster is up, and both nodes are online, but I can not for the life of me get the second node to recognize the clustered volume group. These are the directions I used:
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/Global_File_System_2/ch-clustsetup-GFS2.html
Some information about our setup:
RHEL7.2
Both nodes are running on vmware, with each node having a SAN LUN presented to both. Cluster communication is via "private" network between just these two nodes.
Cluster information: (note all these commands were run on node-1, unless noted)
Cluster name: infastage WARNING: corosync and pacemaker node names do not match (IPs used in setup?) Last updated: Thu Sep 29 10:59:03 2016 Last change: Thu Sep 29 10:51:11 2016 by root via cibadmin on MN-INFASTG1 Stack: corosync Current DC: MN-INFASTG1 (version 1.1.13-10.el7_2.4-44eb2dd) - partition with quorum 2 nodes and 7 resources configured Online: [ MN-INFASTG1 MN-INFASTG2 ] Full list of resources: scsi (stonith:fence_scsi): Started MN-INFASTG2 Clone Set: dlm-clone [dlm] Started: [ MN-INFASTG1 MN-INFASTG2 ] Clone Set: clvmd-clone [clvmd] Started: [ MN-INFASTG1 MN-INFASTG2 ] Clone Set: gfsvolfs_res-clone [gfsvolfs_res] Started: [ MN-INFASTG1 ] Stopped: [ MN-INFASTG2 ] Failed Actions: * gfsvolfs_res_start_0 on MN-INFASTG2 'not installed' (5): call=71, status=complete, exitreason='Couldn't find device [/dev/infa_storage/infa_storage_lv]. Expected /dev/??? to exist', last-rc-change='Thu Sep 29 10:46:03 2016', queued=1ms, exec=47ms PCSD Status: MN-INFASTG1 (192.168.72.121): Online MN-INFASTG2 (192.168.72.122): Online Daemon Status: corosync: active/enabled pacemaker: active/enabled pcsd: active/enabled
Volume Group:
vgs VG #PV #LV #SN Attr VSize VFree infa_quorum 1 1 0 wz--n- 496.00m 44.00m infa_storage 1 1 0 wz--nc 500.00g 0 rhel 1 2 0 wz--n- 49.51g 44.00m
Logical Volume:
--- Logical volume --- LV Path /dev/infa_storage/infa_storage_lv LV Name infa_storage_lv VG Name infa_storage LV UUID 8bBa4P-SGjN-Pewn-Cw2B-kfSq-0jnc-bv1Umr LV Write Access read/write LV Creation host, time MN-INFASTG1, 2016-09-29 10:37:45 -0500 LV Status available # open 1 LV Size 500.00 GiB Current LE 127999 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 8192 Block device 253:3
As you can see, it is referring to the path as /dev/xyzwhatever, but on the second node this does not exist. The logical volume is listed as clustered, but not shared, and I can't figure out how to change that. I tried vgchange -asy as per the man page for vgchange, but that still doesn't work.
I can see the LUN via fdisk:
(fdisk run on second node)
Disk /dev/sdc: 536.9 GB, 536870912000 bytes, 1048576000 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk label type: dos Disk identifier: 0xaa5e83d7 Device Boot Start End Blocks Id System /dev/sdc1 2048 1048575999 524286976 83 Linux
But there are no entries in /dev.
Also you can see it being marked as "clustered" but not "shared":
(vgs run on second node)
--- Volume group --- VG Name infa_storage System ID Format lvm2 Metadata Areas 1 Metadata Sequence No 4 VG Access read/write VG Status resizable Clustered yes Shared no MAX LV 0 Cur LV 1 Open LV 0 Max PV 0 Cur PV 1 Act PV 1 VG Size 500.00 GiB PE Size 4.00 MiB Total PE 127999 Alloc PE / Size 127999 / 500.00 GiB Free PE / Size 0 / 0 VG UUID gET6fv-zMIf-JR9N-n24k-uIaj-RdgF-0OeM5J
Any help would be appreciated, i'm pulling my hair out trying to figure out why this isn't working.
Responses