Troubles with shared storage with GFS2
Hi folks,
I'm attempting to create a two node active-active cluster for use with an application, and I'm having issues getting the shared storage working.
The cluster is up, and both nodes are online, but I can not for the life of me get the second node to recognize the clustered volume group. These are the directions I used:
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/Global_File_System_2/ch-clustsetup-GFS2.html
Some information about our setup:
RHEL7.2
Both nodes are running on vmware, with each node having a SAN LUN presented to both. Cluster communication is via "private" network between just these two nodes.
Cluster information: (note all these commands were run on node-1, unless noted)
Cluster name: infastage
WARNING: corosync and pacemaker node names do not match (IPs used in setup?)
Last updated: Thu Sep 29 10:59:03 2016 Last change: Thu Sep 29 10:51:11 2016 by root via cibadmin on MN-INFASTG1
Stack: corosync
Current DC: MN-INFASTG1 (version 1.1.13-10.el7_2.4-44eb2dd) - partition with quorum
2 nodes and 7 resources configured
Online: [ MN-INFASTG1 MN-INFASTG2 ]
Full list of resources:
scsi (stonith:fence_scsi): Started MN-INFASTG2
Clone Set: dlm-clone [dlm]
Started: [ MN-INFASTG1 MN-INFASTG2 ]
Clone Set: clvmd-clone [clvmd]
Started: [ MN-INFASTG1 MN-INFASTG2 ]
Clone Set: gfsvolfs_res-clone [gfsvolfs_res]
Started: [ MN-INFASTG1 ]
Stopped: [ MN-INFASTG2 ]
Failed Actions:
* gfsvolfs_res_start_0 on MN-INFASTG2 'not installed' (5): call=71, status=complete, exitreason='Couldn't find device [/dev/infa_storage/infa_storage_lv]. Expected /dev/??? to exist',
last-rc-change='Thu Sep 29 10:46:03 2016', queued=1ms, exec=47ms
PCSD Status:
MN-INFASTG1 (192.168.72.121): Online
MN-INFASTG2 (192.168.72.122): Online
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
Volume Group:
vgs
VG #PV #LV #SN Attr VSize VFree
infa_quorum 1 1 0 wz--n- 496.00m 44.00m
infa_storage 1 1 0 wz--nc 500.00g 0
rhel 1 2 0 wz--n- 49.51g 44.00m
Logical Volume:
--- Logical volume ---
LV Path /dev/infa_storage/infa_storage_lv
LV Name infa_storage_lv
VG Name infa_storage
LV UUID 8bBa4P-SGjN-Pewn-Cw2B-kfSq-0jnc-bv1Umr
LV Write Access read/write
LV Creation host, time MN-INFASTG1, 2016-09-29 10:37:45 -0500
LV Status available
# open 1
LV Size 500.00 GiB
Current LE 127999
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 8192
Block device 253:3
As you can see, it is referring to the path as /dev/xyzwhatever, but on the second node this does not exist. The logical volume is listed as clustered, but not shared, and I can't figure out how to change that. I tried vgchange -asy as per the man page for vgchange, but that still doesn't work.
I can see the LUN via fdisk:
(fdisk run on second node)
Disk /dev/sdc: 536.9 GB, 536870912000 bytes, 1048576000 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0xaa5e83d7
Device Boot Start End Blocks Id System
/dev/sdc1 2048 1048575999 524286976 83 Linux
But there are no entries in /dev.
Also you can see it being marked as "clustered" but not "shared":
(vgs run on second node)
--- Volume group ---
VG Name infa_storage
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 4
VG Access read/write
VG Status resizable
Clustered yes
Shared no
MAX LV 0
Cur LV 1
Open LV 0
Max PV 0
Cur PV 1
Act PV 1
VG Size 500.00 GiB
PE Size 4.00 MiB
Total PE 127999
Alloc PE / Size 127999 / 500.00 GiB
Free PE / Size 0 / 0
VG UUID gET6fv-zMIf-JR9N-n24k-uIaj-RdgF-0OeM5J
Any help would be appreciated, i'm pulling my hair out trying to figure out why this isn't working.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
