OCS 3.11 - Pod fails to start with MountVolume.WaitForAttach - iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
Issue
This is an OCS Independent Mode configuration, three gluster pods running RHGS 3.5.0
When deployings PODs we get this event:
14s 22m 18 elasticsearch-1.160bda3463e3f84f Pod Warning FailedMount kubelet, worker01 MountVolume.WaitForAttach failed for volume "pvc-e928a805-15f1-11ea-89ce-0050568948c2" : failed to get any path for iscsi disk, last err seen:
iscsi: failed to attach disk: Error: iscsiadm: Could not login to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260].
iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
iscsiadm: Could not login to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260].
iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
iscsiadm: Could not login to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260].
iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
iscsiadm: Could not log into all portals
Logging in to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260] (multiple)
Logging in to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260] (multiple)
Logging in to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260] (multiple)
(exit status 24)
At the same time, on the OCS gluster node we see some iscsi logs on /var/log/messages:
May 4 17:03:08 gluster-0 kernel: CHAP user or password not set for Initiator ACL
May 4 17:03:08 gluster-0 kernel: Security negotiation failed.
May 4 17:03:08 gluster-0 kernel: iSCSI Login negotiation failed.
The pods stays in 'ContainerCreating' waiting for the PV.
Environment
- Red Hat Openshift Container Storage 3.11.4
- Red Hat Openshift Container Storage 3.11.5
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.