Why do we see error message "ethX nx_nic: Firmware hang detected" in system log?

Solution Verified - Updated -

Environment

  • Red Hat Enterprise Linux 5
  • NetXen Incorporated NX3031 Multifunction 1/10-Gigabit Server Adapter'
  • ProLiant DL580 G7

Issue

  • ethX nx_nic: Firmware hang detected.
  • Able to see the below errors in logs.
Mar 10 12:34:13 kernel: nx_nic[eth6]: Firmware hang detected. Severity code=0 Peg number=0 Error code=0 Return address=0  
Mar 10 12:34:13 kernel: nx_nic[eth6]: Load stored FW  
Mar 10 12:34:19 kernel: nx_nic HP NC522SFP Dual Port 10GbE Server Adapter Board S/N CM9ABK0034  Chip id 0x1  
Mar 10 12:34:23 kernel: nx_nic[eth6]: Unable to create the rx context, code 17 Error: Timed Out  
Mar 10 12:34:23 kernel: nx_nic[eth6]: RX ctx allocation FAILED  
Mar 10 12:34:23 kernel: nx_nic[eth6]: Error in setting hw resources: -1  
Mar 10 12:34:27 kernel: nx_nic[eth7]: Failed in query of FW for max LRO  
Mar 10 12:34:27 kernel: nx_nic[eth7]: LRO Initialization failed  
Mar 10 12:34:32 kernel: nx_nic[eth6]: Device is UP.  
Mar 10 12:35:17 kernel: nx_nic[eth6]: Device is DOWN. Fail count[8]  
Mar 10 12:35:17 kernel: nx_nic[eth6]: Firmware hang detected. Severity code=0 Peg number=0 Error code=0 Return address=0
  • Found following messages in system log :
Mar  5 01:44:24 XXX kernel: nx_nic[eth5]: Cmd Peg initialization not complete:ff09.
Mar  5 01:44:24 XXX kernel: nx_nic[eth5]: Failed to init firmware
Mar  5 01:44:24 XXX kernel: nx_nic[eth5]: Failed to Attach to device
Mar  5 01:44:24 XXX /etc/sysconfig/network-scripts/ifup-eth: Failed to bring up eth5.
  • And output of ethtool shows following :
ethtool ethX
Settings for ethX:
        Supported ports: [ TP ]
        Supported link modes:
        Supports auto-negotiation: Yes
        Advertised link modes:  100baseT/Half 100baseT/Full
                                1000baseT/Half 1000baseT/Full
        Advertised auto-negotiation: Yes
        Speed: Unknown!
        Duplex: Half
        Port: Twisted Pair
        PHYAD: 1
        Transceiver: external
        Auto-negotiation: off
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000005 (5)
        Link detected: no

Resolution

  • The ethernet card is using nx_nic driver, this driver is not provided by Red Hat but is a third party NIC driver, nx_nic from HP. In this case, please contact HP for more information on the firmware issues. This error is indicating that the firmware on the card has hung, and a firmware update may be required to resolve this.
  • Alternatively, switch to the netxen_nic module, which is shipped by Red Hat for QLogic/NetXen (1/10) GbE Converged Ethernet Driver.

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments