OCS 3.11 - Pod fails to start with MountVolume.WaitForAttach - iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)

Solution Verified - Updated -

Issue

This is an OCS Independent Mode configuration, three gluster pods running RHGS 3.5.0

When deployings PODs we get this event:

14s       22m       18        elasticsearch-1.160bda3463e3f84f   Pod                 Warning   FailedMount   kubelet, worker01   MountVolume.WaitForAttach failed for volume "pvc-e928a805-15f1-11ea-89ce-0050568948c2" : failed to get any path for iscsi disk, last err seen:
iscsi: failed to attach disk: Error: iscsiadm: Could not login to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260].
iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
iscsiadm: Could not login to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260].
iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
iscsiadm: Could not login to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260].
iscsiadm: initiator reported error (24 - iSCSI login failed due to authorization failure)
iscsiadm: Could not log into all portals
Logging in to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260] (multiple)
Logging in to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260] (multiple)
Logging in to [iface: default, target: iqn.2016-12.org.gluster-block:47ea38f1-b2e7-491e-856f-468c994240fc, portal: 10.0.0.93,3260] (multiple)
 (exit status 24)

At the same time, on the OCS gluster node we see some iscsi logs on /var/log/messages:

May  4 17:03:08 gluster-0 kernel: CHAP user or password not set for Initiator ACL
May  4 17:03:08 gluster-0 kernel: Security negotiation failed.
May  4 17:03:08 gluster-0 kernel: iSCSI Login negotiation failed.

The pods stays in 'ContainerCreating' waiting for the PV.

Environment

  • Red Hat Openshift Container Storage 3.11.4
  • Red Hat Openshift Container Storage 3.11.5

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content