System crashed by 'gab' after getting the error 'Blocking buffer reads for recovery...'

Issue

• System crashed with the below log

...
[3555658.295232] vxfs: msgcnt 125 - /dev/vx/dsk/sasclusdg-rhel9/sas_uservol - Log replay finished with error 0

[3555661.455125] vxfs: msgcnt 126 - /dev/vx/dsk/sasclusdg-rhel9/sas_workvol - Log replay finished with error 0

[3555665.162427] GAB INFO V-15-1-20033 Port a[GAB_Control (refcount 1)] nid 0     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [1:0:0:0]    [0:0:0:0]  22   b98002   20 48
[3555665.162433] GAB INFO V-15-1-20239 Initiating FFDC data collection
[3555665.164517] GAB INFO V-15-1-20033 Port a[GAB_Control (refcount 1)] nid 1     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [16:0:0:0]    [0:0:0:0]  22   b98002   20 36
[3555665.165828] GAB INFO V-15-1-20033 Port a[GAB_Control (refcount 1)] nid 2     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [16:0:0:0]    [0:0:0:0]  22   b98002   20 37
[3555665.167138] GAB INFO V-15-1-20033 Port a[GAB_Control (refcount 1)] nid 3     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [28:0:0:0]    [0:0:0:0]  22   b98002   20 43
[3555665.168474] GAB INFO V-15-1-20033 Port a[GAB_Control (refcount 1)] nid 4     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [16:0:0:0]    [0:0:0:0]  22   b98002   20 35
[3555665.169821] GAB INFO V-15-1-20033 Port a[GAB_Control (refcount 1)] nid 5     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [28:0:0:0]    [0:0:0:0]  22   b98002   20 41
[3555665.171338] GAB INFO V-15-1-20032 Port a closed
[3555665.173204] GAB INFO V-15-1-20239 Initiating FFDC data collection
[3555665.184835] GAB INFO V-15-1-20033 Port y[GAB_LEGACY_CLIENT (refcount 0)] nid 0     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [1:0:0:0]    [0:0:0:0]  22   b9800e   20 42
[3555665.186227] GAB INFO V-15-1-20033 Port y[GAB_LEGACY_CLIENT (refcount 0)] nid 1     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [16:0:0:0]    [0:0:0:0]  22   b9800e   20 29
[3555665.187642] GAB INFO V-15-1-20033 Port y[GAB_LEGACY_CLIENT (refcount 0)] nid 2     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [16:0:0:0]    [0:0:0:0]  22   b9800e   20 29
[3555665.189083] GAB INFO V-15-1-20033 Port y[GAB_LEGACY_CLIENT (refcount 0)] nid 3     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [28:0:0:0]    [0:0:0:0]  22   b9800e   20 34
[3555665.190533] GAB INFO V-15-1-20033 Port y[GAB_LEGACY_CLIENT (refcount 0)] nid 4     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [16:0:0:0]    [0:0:0:0]  22   b9800e   20 25
[3555665.192028] GAB INFO V-15-1-20033 Port y[GAB_LEGACY_CLIENT (refcount 0)] nid 5     [3f:0:0:0]    [3f:0:0:0]    [3f:0:0:0]    [28:0:0:0]    [0:0:0:0]  22   b9800e   20 30
[3555665.193525] Kernel panic - not syncing: GAB: Port y halting system due to network failure at [14:2341]
[3555665.194271] CPU: 2 PID: 527599 Comm: lltdlv Kdump: loaded Tainted: P        W  OE     -------  ---  5.14.0-427.42.1.el9_4.x86_64 #1
[3555665.195038] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.18227214.B64.2106252220 06/25/2021
[3555665.195819] Call Trace:
[3555665.196595]  <TASK>
[3555665.197363]  dump_stack_lvl+0x34/0x48
[3555665.198132]  panic+0x107/0x2f7
[3555665.198906]  gab_halt+0x61/0x70 [gab]
[3555665.199719]  ? __pfx_gab_halt+0x10/0x10 [gab]
[3555665.200498]  ? gab_timeout+0x61/0x80 [gab]
[3555665.201276]  gab_recv_iofence+0x48c/0x490 [gab]
[3555665.202079]  gab_receive+0x810/0x1970 [gab]
[3555665.202874]  ? gab_receive_port_que+0x12f/0x9f0 [gab]
[3555665.203652]  gab_receive_port_que+0x12f/0x9f0 [gab]
[3555665.204437]  ? gab_receive_que+0xce/0x260 [gab]
[3555665.205218]  gab_receive_que+0xce/0x260 [gab]
[3555665.206009]  gab_lrecv+0x150/0x470 [gab]
[3555665.206808]  llt_make_recvupcall+0x78/0x160 [llt]
[3555665.207633]  llt_lrsrv_port+0x4ea/0xf40 [llt]
[3555665.208440]  ? put_prev_task_rt+0x130/0x130
[3555665.209197]  ? __pfx_llt_deliver+0x10/0x10 [llt]
[3555665.209963]  llt_deliver+0xfa/0x210 [llt]
[3555665.210720]  kthread+0xdd/0x100
[3555665.211446]  ? __pfx_kthread+0x10/0x10
[3555665.212186]  ret_from_fork+0x29/0x50
[3555665.212890]  </TASK>