Server was Unresponsive due to Firmware Bug

Issue

• The qlcnic driver reports firmware hang detected and interfaces reset

  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.1: Pause control frames disabled on all ports
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.1: firmware hang detected
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.0: Pause control frames disabled on all ports
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.0: firmware hang detected
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.0: Dumping hw/fw registers
  May 23 12:55:07 localhost kernel: PEG_HALT_STATUS1: 0x40001503, PEG_HALT_STATUS2: 0x3e1980,
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.1: Pause control frames disabled on all ports
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.1: firmware hang detected
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.0: Pause control frames disabled on all ports
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.0: firmware hang detected
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.0: Dumping hw/fw registers
  May 23 12:55:07 localhost kernel: PEG_HALT_STATUS1: 0x40001503, PEG_HALT_STATUS2: 0x3e1980,
  May 23 12:55:07 localhost kernel: PEG_NET_0_PC: 0x6d8c5, PEG_NET_1_PC: 0x6d9e9,
  May 23 12:55:07 localhost kernel: PEG_NET_2_PC: 0x6e81f, PEG_NET_3_PC: 0x149,
  May 23 12:55:07 localhost kernel: PEG_NET_4_PC: 0x66f58
  May 23 12:55:07 localhost kernel: PEG_NET_0_PC: 0x6d8c5, PEG_NET_1_PC: 0x6d9e9,
  May 23 12:55:07 localhost kernel: PEG_NET_2_PC: 0x6e81f, PEG_NET_3_PC: 0x149,
  May 23 12:55:07 localhost kernel: PEG_NET_4_PC: 0x66f58
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.1: Dumping hw/fw registers
  May 23 12:55:07 localhost kernel: PEG_HALT_STATUS1: 0x40001503, PEG_HALT_STATUS2: 0x3e1980,
  May 23 12:55:07 localhost kernel: PEG_NET_0_PC: 0x6d8c5, PEG_NET_1_PC: 0x6d9e9,
  May 23 12:55:07 localhost kernel: qlcnic 0000:01:00.1: Dumping hw/fw registers
  May 23 12:55:07 localhost kernel: PEG_HALT_STATUS1: 0x40001503, PEG_HALT_STATUS2: 0x3e1980,
  May 23 12:55:07 localhost kernel: PEG_NET_0_PC: 0x6d8c5, PEG_NET_1_PC: 0x6d9e9,
  May 23 12:55:07 localhost kernel: PEG_NET_2_PC: 0x6e81f, PEG_NET_3_PC: 0x149,
  May 23 12:55:07 localhost kernel: PEG_NET_4_PC: 0x66f58
  May 23 12:55:07 localhost kernel: PEG_NET_2_PC: 0x6e81f, PEG_NET_3_PC: 0x149,
  May 23 12:55:07 localhost kernel: PEG_NET_4_PC: 0x66f58
  

• This is also seen by the qla2xxx storage driver on the Converged Network Adapter