System crashed with a general protection fault at native_read_pmc on VMware guest whilst running perf
Environment
- Red Hat Enterprise Linux 6.6
- 2.6.32-504.3.3.el6.x86_64
- VMware guest
- perf is running
Issue
- System crashed and the following is seen in the vmcore log output:
general protection fault: 0000 [#1] SMP
last sysfs file: /sys/devices/system/cpu/online
CPU 4
Modules linked in: autofs4 ipv6 ppdev parport_pc parport microcode vmware_balloon sg i2c_piix4 i2c_core shpchp ext4 jbd2 mbcache sd_mod crc_t10dif sr_mod cdrom vmxnet3 vmw_pvscsi pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: speedstep_lib]
Pid: 23960, comm: java Not tainted 2.6.32-504.3.3.el6.x86_64 #1 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
RIP: 0010:[<ffffffff810410db>] [<ffffffff810410db>] native_read_pmc+0xb/0x20
RSP: 0018:ffff880173fb3898 EFLAGS: 00010083
RAX: 0000000000000001 RBX: ffff8801be5ab400 RCX: 0000000040000002
RDX: 0000000000000000 RSI: 0000000000130300 RDI: 0000000040000002
RBP: ffff880173fb3898 R08: 0000000000000004 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: ffffffff80000001
R13: ffff88002830bc40 R14: ffff8801be5ab570 R15: 0000000000000030
FS: 00007f641eddd700(0000) GS:ffff880028300000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000003de2e8aaf0 CR3: 000000010843c000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process java (pid: 23960, threadinfo ffff880173fb2000, task ffff8801009fcaa0)
Stack:
ffff880173fb38d8 ffffffff8101d4e3 0000000000000000 ffff8801be5ab400
<d> ffff8800283184f8 ffff88002830bc40 ffff8801be5ab400 ffff8801be5ab400
<d> ffff880173fb3908 ffffffff8101d92a ffff8801be5ab400 ffff8800283184f8
Call Trace:
[<ffffffff8101d4e3>] x86_pmu_stop+0x93/0x150
[<ffffffff8101d92a>] x86_pmu_del+0x4a/0x110
[<ffffffff81118758>] event_sched_out+0x108/0x1d0
[<ffffffff81118849>] group_sched_out+0x29/0x90
[<ffffffff81119c0d>] ctx_sched_out+0xed/0x110
[<ffffffff8111bf1a>] __perf_event_task_sched_out+0x10a/0x2d0
[<ffffffff81063bf3>] perf_event_task_sched_out+0x33/0x70
[<ffffffff81529823>] schedule+0x293/0x3a0
[<ffffffff810a3ab3>] ? __hrtimer_start_range_ns+0x1a3/0x460
[<ffffffff810b226a>] futex_wait_queue_me+0xba/0xf0
[<ffffffff810b33a0>] futex_wait+0x1c0/0x310
[<ffffffff810a2dd0>] ? hrtimer_wakeup+0x0/0x30
[<ffffffff810a3da4>] ? hrtimer_start_range_ns+0x14/0x20
[<ffffffff810b4c91>] do_futex+0x121/0xae0
[<ffffffff81063bf3>] ? perf_event_task_sched_out+0x33/0x70
[<ffffffff8105e0d0>] ? __dequeue_entity+0x30/0x50
[<ffffffff8100988e>] ? __switch_to+0x26e/0x320
[<ffffffff8152997e>] ? thread_return+0x4e/0x7d0
[<ffffffff810b56cb>] sys_futex+0x7b/0x170
[<ffffffff810e5a7e>] ? __audit_syscall_exit+0x25e/0x290
[<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
Code: c8 c9 c3 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 89 f0 89 f9 48 89 e5 0f 30 31 c0 c9 c3 66 90 55 48 89 e5 0f 1f 44 00 00 89 f9 <0f> 33 89 c7 48 89 d0 48 c1 e0 20 89 f9 48 09 c8 c9 c3 0f 1f 00
RIP [<ffffffff810410db>] native_read_pmc+0xb/0x20
RSP <ffff880173fb3898>
Resolution
- This issue is being tracked in Red Hat Bugzilla 1178606 (bug not publicly accessible, please
contact your Red Hat Support representative if more information is required).
Diagnostic Steps
- Review a vmcore or output from a crash for a stack similar to that listed in the description.
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
