Connecting to nvme target is failing.

Issue

• Connecting to nvme target is failing with the following messages

[82677.326842] nvme nvme2: NVME-FC{2}: create association : host wwpn 0x100000109bc04688  rport wwpn 0x50060e1234567360: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00001"
[82677.326852] nvme nvme3: NVME-FC{3}: create association : host wwpn 0x100000109bc04688  rport wwpn 0x50060e1234567360: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00002"
[82677.327088] lpfc 0000:86:00.0: queue 0 connect admin queue failed (-6).
[82677.327161] lpfc 0000:86:00.0: queue 0 connect admin queue failed (-6).
[82677.328342] nvme nvme2: NVME-FC{2}: reset: Reconnect attempt failed (-6)
[82677.329792] nvme nvme3: NVME-FC{3}: reset: Reconnect attempt failed (-6)
[82677.329792] nvme nvme2: NVME-FC{2}: Reconnect attempt in 2 seconds
[82677.329800] nvme nvme3: NVME-FC{3}: Reconnect attempt in 2 seconds
[82679.374879] nvme nvme2: NVME-FC{2}: create association : host wwpn 0x100000109bc04688  rport wwpn 0x50060e1234567360: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00001"
[82679.374890] nvme nvme3: NVME-FC{3}: create association : host wwpn 0x100000109bc04688  rport wwpn 0x50060e1234567360: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00002"
[82679.375136] lpfc 0000:86:00.0: queue 0 connect admin queue failed (-6).
[82679.376339] nvme nvme2: NVME-FC{2}: reset: Reconnect attempt failed (-6)
[82679.376344] nvme nvme2: NVME-FC{2}: Reconnect attempt in 2 seconds
[82679.376362] lpfc 0000:86:00.0: queue 0 connect admin queue failed (-6).
[82679.377545] nvme nvme3: NVME-FC{3}: reset: Reconnect attempt failed (-6)
[82679.377550] nvme nvme3: NVME-FC{3}: Reconnect attempt in 2 seconds
[82681.422912] nvme nvme2: NVME-FC{2}: create association : host wwpn 0x100000109bc04688  rport wwpn 0x50060e1234567360: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00001"
[82681.422920] nvme nvme3: NVME-FC{3}: create association : host wwpn 0x100000109bc04688  rport wwpn 0x50060e1234567360: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00002"
[82681.423158] lpfc 0000:86:00.0: queue 0 connect admin queue failed (-6).
[82681.423233] lpfc 0000:86:00.0: queue 0 connect admin queue failed (-6).
[82681.424368] nvme nvme2: NVME-FC{2}: reset: Reconnect attempt failed (-6)
[82681.425550] nvme nvme2: NVME-FC{2}: Max reconnect attempts (300) reached.
[82681.425550] nvme nvme3: NVME-FC{3}: reset: Reconnect attempt failed (-6)
[82681.425558] nvme nvme3: NVME-FC{3}: Max reconnect attempts (300) reached.
[82681.425562] nvme nvme2: Removing ctrl: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00001"
[82681.425566] nvme nvme3: Removing ctrl: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00002"


Aug 26 09:22:46 hostname kernel: [148886.366373] nvme nvme0: NVME-FC{0}: create association : host wwpn 0x100000123456aca0  rport wwpn 0x50060e1234567370: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00001"
Aug 26 09:22:46 hostname kernel: [148886.366386] lpfc 0000:18:00.0: 0:(0):6073 Binding ADM HdwQueue 0  (cpu 46) to hdw_queue 0 qhandle xffff9c9640fbed00
Aug 26 09:22:46 hostname kernel: [148886.366400] lpfc 0000:18:00.0: 0:(0):6149 NVMEx LS REQ: Issue to DID 0xb50060 lsreq xffff9cf60c10c800, rqstlen:1024 rsplen:56 0x00000061cc10c898 0x00000061cc10cc98
Aug 26 09:22:46 hostname kernel: [148886.366413] lpfc 0000:18:00.0: 0:(0):6050 Issue GEN REQ WQE to NPORT xb50060 Data: oxid: x3b state: x20 wq:xffff9c97c12d6600 lsreq:xffff9cf60c10c800 bmp:xffff9c96c005a440 xmit:1024 1st:1024
Aug 26 09:22:46 hostname kernel: [148886.366773] lpfc 0000:18:00.0: 0:(0):6047 NVMEx LS REQ xffff9cf60c10c800 cmpl DID b50060 Xri: 3b status 0 reason x0 cmd:xffff9c97c12d6600 lsreg:xffff9cf60c10c800 bmp:xffff9c96c005a440 ndlp:xffff9cf49161ea00
Aug 26 09:22:46 hostname kernel: [148886.366792] lpfc 0000:18:00.0: queue 0 connect admin queue failed (-6).
Aug 26 09:22:46 hostname kernel: [148886.368291] lpfc 0000:18:00.0: 0:(0):6001 ENTER.  lpfc_pnvme xffff9c9ac0143db8, qidx x0 qhandle xffff9c9640fbed00
Aug 26 09:22:46 hostname kernel: [148886.368299] nvme nvme0: NVME-FC{0}: reset: Reconnect attempt failed (-6)
Aug 26 09:22:46 hostname kernel: [148886.368303] nvme nvme0: NVME-FC{0}: Reconnect attempt in 2 seconds
Aug 26 09:22:46 hostname kernel: nvme nvme0: NVME-FC{0}: create association : host wwpn 0x100000123456aca0  rport wwpn 0x50060e1234567370: NQN "nqn.1994-04.name.co.hitachi:nvme:storage-subsystem-sn.5-33043-nvmssid.00001"
Aug 26 09:22:46 hostname kernel: lpfc 0000:18:00.0: 0:(0):6073 Binding ADM HdwQueue 0  (cpu 46) to hdw_queue 0 qhandle xffff9c9640fbed00
Aug 26 09:22:46 hostname kernel: lpfc 0000:18:00.0: 0:(0):6149 NVMEx LS REQ: Issue to DID 0xb50060 lsreq xffff9cf60c10c800, rqstlen:1024 rsplen:56 0x00000061cc10c898 0x00000061cc10cc98
Aug 26 09:22:46 hostname kernel: lpfc 0000:18:00.0: 0:(0):6050 Issue GEN REQ WQE to NPORT xb50060 Data: oxid: x3b state: x20 wq:xffff9c97c12d6600 lsreq:xffff9cf60c10c800 bmp:xffff9c96c005a440 xmit:1024 1st:1024
Aug 26 09:22:46 hostname kernel: lpfc 0000:18:00.0: 0:(0):6047 NVMEx LS REQ xffff9cf60c10c800 cmpl DID b50060 Xri: 3b status 0 reason x0 cmd:xffff9c97c12d6600 lsreg:xffff9cf60c10c800 bmp:xffff9c96c005a440 ndlp:xffff9cf49161ea00
Aug 26 09:22:46 hostname kernel: lpfc 0000:18:00.0: queue 0 connect admin queue failed (-6).
Aug 26 09:22:46 hostname kernel: lpfc 0000:18:00.0: 0:(0):6001 ENTER.  lpfc_pnvme xffff9c9ac0143db8, qidx x0 qhandle xffff9c9640fbed00
Aug 26 09:22:46 hostname kernel: nvme nvme0: NVME-FC{0}: reset: Reconnect attempt failed (-6)
Aug 26 09:22:46 hostname kernel: nvme nvme0: NVME-FC{0}: Reconnect attempt in 2 seconds