RHEL6.3 - 6.4: kernel crashes with RIP tick_nohz_stop_sched_tick related to CPU hotplug
Issue
- Symptom: Under RHEL 6U3 and later OS, Waking OS up from S1 power state through power button is fail. After pressing power button, the screen displayed some information and dumped, after several minutes later, the OS start to reboot.
Reproducer
- Login RHEL6U3 x64 OS, open in terminal.
- Input command "echo standby > /sys/power/state", get into S1 power state.
- Wake up OS with power button, check if the server can be waken up normally.
* kernel crashes in tick_nohz_stop_sched_tick with BUG: unable to handle kernel NULL pointer dereference at 0000000000000078 similar to
CPU 61 is now offline
CPU 62 is now offline
CPU 63 is now offline
SMP alternatives: switching to UP code
Extended CMOS year: 2000
Back to C!
PCI-DMA: Resuming GART IOMMU
PCI-DMA: Restoring GART aperture settings
[Firmware Bug]: cpu 0, invalid threshold interrupt offset 0 for bank 4, block 1 (MSRC0000408=0xc018000001000000)
[Firmware Bug]: cpu 0, invalid threshold interrupt offset 0 for bank 4, block 2 (MSRC0000409=0xc018000001000000)
Extended CMOS year: 2000
Enabling non-boot CPUs ...
SMP alternatives: switching to SMP code
Booting Node 0 Processor 1 APIC 0x21
BUG: unable to handle kernel NULL pointer dereference at 0000000000000078
IP: [<ffffffff810a2bd5>] tick_nohz_stop_sched_tick+0x2a5/0x3e0
PGD 0
Oops: 0000 [#1] SMP
last sysfs file: /sys/power/state
CPU 1
Modules linked in: fuse ebtable_nat ebtables ipt_MASQUERADE iptable_nat nf_nat xt_CHECKSUM iptable_mangle bridge stp llc autofs4 sunrpc cpufreq_ondemand powernow_k8 freq_table mperf ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 ext3 jbd vhost_net macvtap macvlan tun kvm_amd kvm uinput microcode serio_raw igb dca sg amd64_edac_mod edac_core edac_mce_amd k10temp i2c_piix4 i2c_core shpchp ext4 mbcache jbd2 megaraid_sas sd_mod crc_t10dif ahci dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
Pid: 0, comm: swapper Not tainted 2.6.32-279.el6.x86_64 #1 Supermicro H8QG7/H8QG7
RIP: 0010:[<ffffffff810a2bd5>] [<ffffffff810a2bd5>] tick_nohz_stop_sched_tick+0x2a5/0x3e0
RSP: 0018:ffff880028243f18 EFLAGS: 00010046
RAX: ffffffff81c017c0 RBX: ffff8800282516a0 RCX: 00000024a45a6991
RDX: 0000000000000000 RSI: 0000000000001013 RDI: 00000024a45a597e
RBP: ffff880028243f68 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
R13: 00000024a45a6945 R14: 0000000000000000 R15: 0000000000000096
FS: 0000000000000000(0000) GS:ffff880028240000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000000000078 CR3: 0000000001a85000 CR4: 00000000000406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffff881014d38000, task ffff88081440e040)
Stack:
ffff880028243f58 ffffffff810de025 ffff880028243f58 0000000000000046
<d> 0000000000000001 0000000000000000 0000000000000037 0000000000000007
<d> ffff881014d39e88 0000000000000000 ffff880028243f78 ffffffff81073c96
Call Trace:
<IRQ>
[<ffffffff810de025>] ? handle_edge_irq+0x175/0x180
[<ffffffff81073c96>] irq_exit+0x76/0x90
[<ffffffff81505af5>] do_IRQ+0x75/0xf0
[<ffffffff8100ba53>] ret_from_intr+0x0/0x11
<EOI>
[<ffffffff814f6bd9>] ? start_secondary+0x124/0x26d
[<ffffffff814f6bd5>] ? start_secondary+0x120/0x26d
Code: 8b 05 b8 cb d7 00 f0 44 0f b3 20 bf 01 00 00 00 e8 51 0d fd ff 48 8b 7d c0 48 89 bb d8 00 00 00 48 8b 45 c8 48 89 83 d0 00 00 00 <49> 8b 46 78 4c 29 e8 48 89 83 c8 00 00 00 4c 89 ff 57 9d 66 66
RIP [<ffffffff810a2bd5>] tick_nohz_stop_sched_tick+0x2a5/0x3e0
RSP <ffff880028243f18>
CR2: 0000000000000078
Environment
- Red Hat Enterprise Linux 6
- Seen on RHEL6.3 and RHEL6.4
- kernels 2.6.32-279.el6 - 2.6.32-358.el6
- CPU hotplugging
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
