Troubles with shared storage with GFS2

Latest response

Hi folks,

I'm attempting to create a two node active-active cluster for use with an application, and I'm having issues getting the shared storage working.

The cluster is up, and both nodes are online, but I can not for the life of me get the second node to recognize the clustered volume group. These are the directions I used:

https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/Global_File_System_2/ch-clustsetup-GFS2.html

Some information about our setup:

RHEL7.2
Both nodes are running on vmware, with each node having a SAN LUN presented to both. Cluster communication is via "private" network between just these two nodes.

Cluster information: (note all these commands were run on node-1, unless noted)

Cluster name: infastage
WARNING: corosync and pacemaker node names do not match (IPs used in setup?)
Last updated: Thu Sep 29 10:59:03 2016          Last change: Thu Sep 29 10:51:11 2016 by root via cibadmin on MN-INFASTG1
Stack: corosync
Current DC: MN-INFASTG1 (version 1.1.13-10.el7_2.4-44eb2dd) - partition with quorum
2 nodes and 7 resources configured

Online: [ MN-INFASTG1 MN-INFASTG2 ]

Full list of resources:

 scsi   (stonith:fence_scsi):   Started MN-INFASTG2
 Clone Set: dlm-clone [dlm]
     Started: [ MN-INFASTG1 MN-INFASTG2 ]
 Clone Set: clvmd-clone [clvmd]
     Started: [ MN-INFASTG1 MN-INFASTG2 ]
 Clone Set: gfsvolfs_res-clone [gfsvolfs_res]
     Started: [ MN-INFASTG1 ]
     Stopped: [ MN-INFASTG2 ]

Failed Actions:
* gfsvolfs_res_start_0 on MN-INFASTG2 'not installed' (5): call=71, status=complete, exitreason='Couldn't find device [/dev/infa_storage/infa_storage_lv]. Expected /dev/??? to exist',
    last-rc-change='Thu Sep 29 10:46:03 2016', queued=1ms, exec=47ms


PCSD Status:
  MN-INFASTG1 (192.168.72.121): Online
  MN-INFASTG2 (192.168.72.122): Online

Daemon Status:
  corosync: active/enabled
  pacemaker: active/enabled
  pcsd: active/enabled

Volume Group:

 vgs
  VG           #PV #LV #SN Attr   VSize   VFree
  infa_quorum    1   1   0 wz--n- 496.00m 44.00m
  infa_storage   1   1   0 wz--nc 500.00g     0
  rhel           1   2   0 wz--n-  49.51g 44.00m

Logical Volume:

  --- Logical volume ---
  LV Path                /dev/infa_storage/infa_storage_lv
  LV Name                infa_storage_lv
  VG Name                infa_storage
  LV UUID                8bBa4P-SGjN-Pewn-Cw2B-kfSq-0jnc-bv1Umr
  LV Write Access        read/write
  LV Creation host, time MN-INFASTG1, 2016-09-29 10:37:45 -0500
  LV Status              available
  # open                 1
  LV Size                500.00 GiB
  Current LE             127999
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:3

As you can see, it is referring to the path as /dev/xyzwhatever, but on the second node this does not exist. The logical volume is listed as clustered, but not shared, and I can't figure out how to change that. I tried vgchange -asy as per the man page for vgchange, but that still doesn't work.

I can see the LUN via fdisk:

(fdisk run on second node)

Disk /dev/sdc: 536.9 GB, 536870912000 bytes, 1048576000 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0xaa5e83d7

   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1            2048  1048575999   524286976   83  Linux

But there are no entries in /dev.

Also you can see it being marked as "clustered" but not "shared":

(vgs run on second node)

--- Volume group ---
  VG Name               infa_storage
  System ID
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  4
  VG Access             read/write
  VG Status             resizable
  Clustered             yes
  Shared                no
  MAX LV                0
  Cur LV                1
  Open LV               0
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               500.00 GiB
  PE Size               4.00 MiB
  Total PE              127999
  Alloc PE / Size       127999 / 500.00 GiB
  Free  PE / Size       0 / 0
  VG UUID               gET6fv-zMIf-JR9N-n24k-uIaj-RdgF-0OeM5J

Any help would be appreciated, i'm pulling my hair out trying to figure out why this isn't working.

Responses

Check your "volume_list" in /etc/lvm/lvm.conf file, volume group "infa_storage" should be present in volume_list

Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.