ISCSI over ISER failed to initiate any sessions after upgrading from 8.6 to 8.7

Solution Verified - Updated -

Environment

  • Red Hat Enterprise Linux 8.7
  • Mellanox Infiniband controller - MT27700 Family
  • Kernel-4.18.0-425.3.1.el8.x86_64

Issue

  • ISCSI storage over iSER is not visible after upgrading from 8.6 to 8.7.
[   24.429189] mlx5_core 0000:11:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(1)
[   24.429197] mlx5_core 0000:11:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(1)
[   32.346107] scsi host3: iSCSI Initiator over iSER
[   32.407213] scsi host4: iSCSI Initiator over iSER
[   32.464966] infiniband mlx5_0: mlx5_handle_error_cqe:333:(pid 0): WC error: 1, Message: local length error
[   32.464974] infiniband mlx5_0: dump_cqe:272:(pid 0): dump error cqe
[   32.464977] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[   32.464979] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[   32.464981] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[   32.464982] 00000030: 00 00 00 00 00 00 d7 01 00 00 01 08 00 03 c6 e2
[   32.464988] iser: iser_err_comp: task_rsp failure: local length error (1) vend_err 0xd7
[   32.464999] infiniband mlx5_0: mlx5_handle_error_cqe:333:(pid 1836): WC error: 1, Message: local length error
[   32.465000]  connection1:0: detected conn error (1011)
[   32.465003] infiniband mlx5_0: dump_cqe:272:(pid 1836): dump error cqe

Resolution

Diagnostic Steps

  • Kernel ring buffer will be logged with the below errors:
[   24.429189] mlx5_core 0000:11:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(1)
[   24.429197] mlx5_core 0000:11:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(1)

[   32.346107] scsi host3: iSCSI Initiator over iSER
[   32.407213] scsi host4: iSCSI Initiator over iSER
[   32.464966] infiniband mlx5_0: mlx5_handle_error_cqe:333:(pid 0): WC error: 1, Message: local length error
[   32.464974] infiniband mlx5_0: dump_cqe:272:(pid 0): dump error cqe
[   32.464977] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[   32.464979] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[   32.464981] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[   32.464982] 00000030: 00 00 00 00 00 00 d7 01 00 00 01 08 00 03 c6 e2
[   32.464988] iser: iser_err_comp: task_rsp failure: local length error (1) vend_err 0xd7
[   32.464999] infiniband mlx5_0: mlx5_handle_error_cqe:333:(pid 1836): WC error: 1, Message: local length error
[   32.465000]  connection1:0: detected conn error (1011)
[   32.465003] infiniband mlx5_0: dump_cqe:272:(pid 1836): dump error cqe
  • No ISCSI Session over iSER will be found.
root@testbox# iscsiadm -m session -P3 
iscsiadm: No active sessions.

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments