Application pod backed by gluster block volume fails to start with error "Heuristic determination of mount point failed"

Issue

Application pods like logging-es-data-master which have a gluster block PVC attached to them fail to start because of volume attach fails.
The volume attach fails with an error similar to below

MountVolume.WaitForAttach failed for volume "pvc-480c12fb-c2b6-11ea-aaf0-005056b34244" : Heuristic determination of mount point failed:stat /var/lib/origin/openshift.local.volumes/plugins/kubernetes.io/iscsi/iface-default/X.X.X.X:3260-iqn.2016-12.org.gluster-block:9164cb24-c11e-4f24-8bfe-e74675a19b94-lun-0: input/output error