System takes ~10 minutes to boot, modprobe prints backtraces in netxen_init
Issue
- System takes ~10 minutes to boot,
modprobe
prints backtraces innetxen_init
- Lengthy Server reboot :
modprobe blocked for more than 120 seconds
- After upgrading two servers yesterday we noticed that the reboot time of the servers seemed to be much longer than expected. Investigation via the console showed that server reporting messages like this:
kernel: INFO: task modprobe:10408 blocked for more than 120 seconds.
kernel: Not tainted 2.6.32-504.16.2.el6.x86_64 #1
kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kernel: ffff885fcc50bb88 0000000000000086 ffff881fd40b4ab0 0000000000000030
kernel: ffff885fcc50bb18 ffffffff8106d1a5 ffff885fcc50baf8 ffff881fd40b4ae8
kernel: ffff884070d15928 ffff884070d158c0 ffff885fd1abe5f8 ffff885fcc50bfd8
kernel: Call Trace:
kernel: [<ffffffff8106d1a5>] ? enqueue_entity+0x125/0x450
kernel: [<ffffffff8152ad25>] schedule_timeout+0x215/0x2e0
kernel: [<ffffffff8106d1a5>] ? enqueue_entity+0x125/0x450
kernel: [<ffffffff8105ded4>] ? check_preempt_wakeup+0x1a4/0x260
kernel: [<ffffffff8106d5cb>] ? enqueue_task_fair+0xfb/0x100
kernel: [<ffffffff8152a9a3>] wait_for_common+0x123/0x180
kernel: [<ffffffff81064bc0>] ? default_wake_function+0x0/0x20
kernel: [<ffffffff8152aabd>] wait_for_completion+0x1d/0x20
kernel: [<ffffffff810982ae>] work_on_cpu+0xae/0xd0
kernel: [<ffffffff812af3b0>] ? local_pci_probe+0x0/0x20
kernel: [<ffffffff8152b2be>] ? mutex_lock+0x1e/0x50
kernel: [<ffffffff812b057b>] pci_device_probe+0xcb/0x120
kernel: [<ffffffff8136c942>] ? driver_sysfs_add+0x62/0x90
kernel: [<ffffffff8136cbdc>] driver_probe_device+0x9c/0x3e0
kernel: [<ffffffff8136cfcb>] __driver_attach+0xab/0xb0
kernel: [<ffffffff8136cf20>] ? __driver_attach+0x0/0xb0
kernel: [<ffffffff8136bdc4>] bus_for_each_dev+0x64/0x90
kernel: [<ffffffff8136c87e>] driver_attach+0x1e/0x20
kernel: [<ffffffff8136b5f8>] bus_add_driver+0x1e8/0x2b0
kernel: [<ffffffff8136d226>] driver_register+0x76/0x140
kernel: [<ffffffff8146dfee>] ? rtnl_unlock+0xe/0x10
kernel: [<ffffffff812b0816>] __pci_register_driver+0x56/0xd0
kernel: [<ffffffffa001b000>] ? netxen_init_module+0x0/0x4d [netxen_nic]
kernel: [<ffffffffa001b000>] ? netxen_init_module+0x0/0x4d [netxen_nic]
kernel: [<ffffffffa001b04b>] netxen_init_module+0x4b/0x4d [netxen_nic]
kernel: [<ffffffff8100204c>] do_one_initcall+0x3c/0x1d0
kernel: [<ffffffff810c00e1>] sys_init_module+0xe1/0x250
kernel: [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
Environment
- HP ProLiant DL980 G7, BIOS
1.70 P66 07/29/2013
- Red Hat Enterprise Linux 6.6 with
kernel-2.6.32-504.16.2.el6.x86_64
- NetXen Incorporated NX3031 Multifunction 1/10-Gigabit Server Adapter (firmware
4.0.588
) usingnetxen_nic
driver
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.