Kernel panic due to thread overran stack, or stack corrupted with unsigned (U) kernel module "openafs"
Issue
- Kernel panic with following call traces;
[3556022.482087] WARNING: at kernel/softirq.c:159 local_bh_enable_ip+0x7d/0xb0() (Tainted: P ---------------)
[3556022.482816] BUG: unable to handle kernel paging request at fffffffd952dd320
[3556022.483351] IP: [<ffffffff8105a6e4>] update_curr+0x144/0x1f0
[3556022.483799] PGD 1a87067 PUD 0
[3556022.484295] Thread overran stack, or stack corrupted
[3556022.484665] Oops: 0000 [#1] SMP
[3556022.485159] last sysfs file: /sys/devices/system/cpu/online
[3556022.485536] CPU 11
[3556022.485607] Modules linked in: autofs4 openafs(P)(U) ipv6 microcode iTCO_wdt iTCO_vendor_support power_meter i2c_i801 i2c_core lpc_ich mfd_core tg3 ptp pps_core hpilo hpwdt be2iscsi iscsi_boot_sysfs libiscsi scsi_transport_iscsi be2net sg ext3 jbd mbcache sd_mod crc_t10dif xhci_hcd hpsa wmi dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
[3556022.489965]
[3556022.490330] Pid: 21364, comm: rc.4_per_hour Tainted: P --------------- 2.6.32-431.17.1.el6.x86_64 #1 HP ProLiant DL380 Gen9
[3556022.491178] RIP: 0010:[<ffffffff8105a6e4>] [<ffffffff8105a6e4>] update_curr+0x144/0x1f0
[3556022.491935] RSP: 0018:ffff8810b8843d98 EFLAGS: 00010082
[3556022.492315] RAX: ffff88010826eae0 RBX: ffffffffc26dc078 RCX: ffff88107fef3140
[3556022.493015] RDX: 0000000000019410 RSI: 0000000000000000 RDI: ffff88010826eb18
[3556022.493703] RBP: ffff8810b8843dc8 R08: ffffffff8160c325 R09: 0000000000000001
[3556022.494381] R10: 0000000000000010 R11: 0000000000000001 R12: ffff8810b88568a8
[3556022.495066] R13: 000000000013d1b5 R14: 0000000000000001 R15: ffff88010826eae0
[3556022.495764] FS: 00007f61f14f0700(0000) GS:ffff8810b8840000(0000) knlGS:0000000000000000
[3556022.496459] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[3556022.496833] CR2: fffffffd952dd320 CR3: 0000000107c7b000 CR4: 00000000001407e0
[3556022.497508] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[3556022.498181] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[3556022.498856] Process rc.4_per_hour (pid: 21364, threadinfo ffff880cc26dc000, task ffff88010826eae0)
[3556022.499534] Stack:
[3556022.500281] ffff8810b8843da8 ffffffff810153a3 ffff88010826eb18 ffff8810b88568a8
[3556022.500861] <d> 0000000000000000 0000000000000000 ffff8810b8843df8 ffffffff8105ab2b
[3556022.501858] <d> ffff8810b8856840 000000000000000b 0000000000016840 000000000000000b
[3556022.503213] Call Trace:
[3556022.503582] <IRQ>
[3556022.504019] [<ffffffff810153a3>] ? native_sched_clock+0x13/0x80
[3556022.504401] [<ffffffff8105ab2b>] task_tick_fair+0xdb/0x160
[3556022.504780] [<ffffffff8105dc21>] scheduler_tick+0xc1/0x260
[3556022.505162] [<ffffffff810aca40>] ? tick_sched_timer+0x0/0xc0
[3556022.505541] [<ffffffff81083fae>] update_process_times+0x6e/0x90
[3556022.505919] [<ffffffff810acaa6>] tick_sched_timer+0x66/0xc0
[3556022.506298] [<ffffffff810ec7aa>] ? __rcu_process_callbacks+0x25a/0x350
[3556022.506679] [<ffffffff8109f64e>] __run_hrtimer+0x8e/0x1a0
[3556022.507056] [<ffffffff810a6a6f>] ? ktime_get_update_offsets+0x4f/0xd0
[3556022.507437] [<ffffffff8109f9b6>] hrtimer_interrupt+0xe6/0x260
[3556022.507809] [<ffffffff81031f1d>] local_apic_timer_interrupt+0x3d/0x70
[3556022.508188] [<ffffffff81037159>] ? native_apic_msr_eoi_write+0x19/0x20
[3556022.508567] [<ffffffff81531385>] smp_apic_timer_interrupt+0x45/0x60
[3556022.508942] [<ffffffff8100bb93>] apic_timer_interrupt+0x13/0x20
[3556022.509312] <EOI>
[3556022.509746] [<ffffffff810729f1>] ? vprintk+0x251/0x560
[3556022.510123] [<ffffffff8107a05d>] ? local_bh_enable_ip+0x7d/0xb0
[3556022.510504] [<ffffffff815275f8>] printk+0x41/0x49
[3556022.510878] [<ffffffff8107a05d>] ? local_bh_enable_ip+0x7d/0xb0
[3556022.511260] [<ffffffff81071a6d>] warn_slowpath_common+0x5d/0xc0
[3556022.511637] [<ffffffff81071aea>] warn_slowpath_null+0x1a/0x20
[3556022.512012] [<ffffffff8107a05d>] local_bh_enable_ip+0x7d/0xb0
[3556022.512389] [<ffffffff8152a7cb>] _spin_unlock_bh+0x1b/0x20
[3556022.512767] [<ffffffff8148f52a>] __ip_select_ident+0x6a/0xf0
[3556022.513147] [<ffffffff81498201>] __ip_make_skb+0x2d1/0x380
[3556022.513524] [<ffffffff81498910>] ? ip_generic_getfrag+0x0/0xb0
[3556022.513903] [<ffffffff814983eb>] ip_make_skb+0x13b/0x160
[3556022.514279] [<ffffffff81498910>] ? ip_generic_getfrag+0x0/0xb0
[3556022.514659] [<ffffffff814bd24b>] udp_sendmsg+0x2bb/0x930
[3556022.515038] [<ffffffff814c5dca>] inet_sendmsg+0x4a/0xb0
[3556022.515418] [<ffffffff81447e63>] sock_sendmsg+0x123/0x150
[3556022.515795] [<ffffffff8109af00>] ? autoremove_wake_function+0x0/0x40
[3556022.516174] [<ffffffff8109af00>] ? autoremove_wake_function+0x0/0x40
[3556022.516557] [<ffffffff81447ed1>] kernel_sendmsg+0x41/0x60
[3556022.516960] [<ffffffffa027876e>] osi_NetSend+0x3e/0x50 [openafs]
[3556022.517353] [<ffffffffa021e249>] ? afs_mutex_exit+0x29/0x40 [openafs]
[3556022.517746] [<ffffffffa0220c3e>] rxi_SendPacket+0x14e/0x330 [openafs]
[3556022.518137] [<ffffffffa0212e84>] rxi_SendList+0x2a4/0x2c0 [openafs]
[3556022.518540] [<ffffffffa024d1b5>] ? afs_FindServer+0x25/0xc0 [openafs]
[3556022.518938] [<ffffffffa026e348>] ? LockAndInstallUVolumeEntry+0x578/0x670 [openafs]
[3556022.519628] [<ffffffffa02130ff>] rxi_SendXmitList+0x25f/0x330 [openafs]
[3556022.520020] [<ffffffffa0218556>] rxi_Start+0x166/0x3c0 [openafs]
[3556022.520411] [<ffffffffa021ba92>] rxi_FlushWrite+0x132/0x1a0 [openafs]
[3556022.520802] [<ffffffffa021d180>] rxi_ReadProc+0x280/0x520 [openafs]
[3556022.521189] [<ffffffffa021d471>] rx_ReadProc32+0x51/0xc0 [openafs]
[3556022.521583] [<ffffffffa0222cae>] xdrrx_getint32+0x1e/0x40 [openafs]
[3556022.521968] [<ffffffffa0222c81>] ? xdrrx_putint32+0x21/0x30 [openafs]
[3556022.522352] [<ffffffffa0210276>] xdr_afs_uint32+0x36/0x40 [openafs]
[3556022.522748] [<ffffffffa0271431>] xdr_AFSFetchStatus+0x21/0x1d0 [openafs]
[3556022.523143] [<ffffffffa02745cc>] RXAFS_FetchStatus+0x17c/0x200 [openafs]
[3556022.523526] [<ffffffff810149b9>] ? read_tsc+0x9/0x20
[3556022.523901] [<ffffffff810a5dd7>] ? getnstimeofday+0x57/0xe0
[3556022.524300] [<ffffffffa0252f47>] afs_FetchStatus+0x117/0x4c0 [openafs]
[3556022.524701] [<ffffffffa026f791>] ? afs_GetVolumeByName+0xa1/0x180 [openafs]
[3556022.525391] [<ffffffffa026f8b3>] ? afs_GetVolume+0x43/0x1c0 [openafs]
[3556022.525785] [<ffffffffa0256431>] afs_GetVCache+0x2e1/0x590 [openafs]
[3556022.526186] [<ffffffffa025f76b>] ? EvalMountPoint+0xbb/0x1a0 [openafs]
[3556022.526582] [<ffffffffa026383f>] afs_lookup+0x17af/0x1d30 [openafs]
[3556022.526979] [<ffffffffa024977b>] ? osi_dnlc_enter+0x25b/0x380 [openafs]
[3556022.527379] [<ffffffffa0283f5d>] afs_linux_dentry_revalidate+0x13d/0x570 [openafs]
[3556022.528077] [<ffffffffa0258069>] ? afs_AccessOK+0x129/0x1f0 [openafs]
[3556022.528476] [<ffffffffa02582cc>] ? afs_access+0x19c/0x790 [openafs]
[3556022.528859] [<ffffffff811a3437>] ? __d_lookup+0xa7/0x150
[3556022.529240] [<ffffffff811985b6>] do_lookup+0x66/0x230
[3556022.529616] [<ffffffff81198a80>] __link_path_walk+0x200/0xff0
[3556022.530001] [<ffffffff81121507>] ? do_read_cache_page+0x97/0x180
[3556022.530383] [<ffffffff81121639>] ? read_cache_page_async+0x19/0x20
[3556022.530762] [<ffffffff81121656>] ? read_cache_page+0x16/0x20
[3556022.531144] [<ffffffff81195d4f>] ? page_getlink+0x4f/0xb0
[3556022.531521] [<ffffffff81199548>] __link_path_walk+0xcc8/0xff0
[3556022.531900] [<ffffffff81198d74>] __link_path_walk+0x4f4/0xff0
[3556022.532279] [<ffffffff8111eb34>] ? file_read_actor+0x44/0x180
[3556022.532658] [<ffffffff81199b2a>] path_walk+0x6a/0xe0
[3556022.533038] [<ffffffff81199d3b>] filename_lookup+0x6b/0xc0
[3556022.533418] [<ffffffff8119ae67>] user_path_at+0x57/0xa0
[3556022.533798] [<ffffffff8109b2fc>] ? remove_wait_queue+0x3c/0x50
[3556022.534176] [<ffffffff8118e6b0>] vfs_fstatat+0x50/0xa0
[3556022.534552] [<ffffffff8118e82b>] vfs_stat+0x1b/0x20
[3556022.542176] [<ffffffff8118e854>] sys_newstat+0x24/0x50
[3556022.542555] [<ffffffff8152d73e>] ? do_page_fault+0x3e/0xa0
[3556022.542932] [<ffffffff8108a3c7>] ? sys_rt_sigprocmask+0xa7/0x100
[3556022.543308] [<ffffffff8152aaf5>] ? page_fault+0x25/0x30
[3556022.543691] [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
[3556022.544065] Code: 00 44 8b 35 b3 01 a4 00 45 85 f6 74 32 48 8b 50 08 8b 5a 18 48 8b 90 10 09 00 00 48 8b 4a 50 48 85 c9 74 1b 48 63 db 48 8b 51 20 <48> 03 14 dd 60 cf bf 81 4c 01 2a 48 8b 49 78 48 85 c9 75 e8 48
[3556022.549227] RIP [<ffffffff8105a6e4>] update_curr+0x144/0x1f0
[3556022.549672] RSP <ffff8810b8843d98>
[3556022.550036] CR2: fffffffd952dd320
Environment
- Red Hat Enterprise Linux 6
- Kernel-2.6.32-431.17.1.el6
- OpenAFS
- Unsigned (U) kernel module: openafs
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.