kdump fails to initialize Chelsio cxgb4 adapters on POWER with RHEL 7
Environment
- Red Hat Enterprise Linux 7
- IBM POWER architecture (others can be prone to this issue as well)
- Chelsio Communications Inc, T422-CR Unified Wire Ethernet Controller
- kernel-3.10.0-123.16.1.el7.ppc64
Issue
- kdump fails to save vmcore to network based destinations (NFS or SSH)
- cxgb4 driver reports failure while probing adapter with "Adapter already initialized" message logged:
[ 4.877078] cxgb4 0000:01:00.4: Using 64-bit direct DMA at offset 800000000000000
[ 5.012412] cxgb4 0000:01:00.4: Coming up as MASTER: Adapter already initialized
[ 5.212421] cxgb4 0000:01:00.4: mbox 4: 1400040080000c04 0 0 0 0 0 0 0
[ 5.232843] cxgb4: probe of 0000:01:00.4 failed with error -12
[ 5.253582] cxgb4 0004:01:00.4: Using 64-bit direct DMA at offset 800000000000000
[ 5.412410] cxgb4 0004:01:00.4: Coming up as MASTER: Adapter already initialized
[ 5.612421] cxgb4 0004:01:00.4: mbox 4: 1400040080000c04 0 0 0 0 0 0 0
[ 5.632872] cxgb4: probe of 0004:01:00.4 failed with error -12
Resolution
- Add cxgb4.force_init=1 to KDUMP_COMMANDLINE_APPEND variable defined in /etc/sysconfig/kdump file so that the diff will look like this and restart kdump:
-KDUMP_COMMANDLINE_APPEND="irqpoll maxcpus=1 noirqdistrib reset_devices cgroup_disable=memory numa=off udev.children-max=2 ehea.use_mcs=0 panic=10 rootflags=nofail"
+KDUMP_COMMANDLINE_APPEND="irqpoll maxcpus=1 noirqdistrib reset_devices cgroup_disable=memory numa=off udev.children-max=2 ehea.use_mcs=0 panic=10 rootflags=nofail cxgb4.force_init=1"
Diagnostic Steps
- Check console messages on screen while testing kdump:
[ 5.012412] cxgb4 0000:01:00.4: Coming up as MASTER: Adapter already initialized
[ 5.232843] cxgb4: probe of 0000:01:00.4 failed with error -12
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
