Panic in perf_callchain_user -> get_segment_base when running perf record in Red Hat Enterprise Linux 7

Solution Unverified - Updated -

Issue

  • Kernel crashed with following log:
[62972.487886] perf: interrupt took too long (2503 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[62972.501814] perf: interrupt took too long (3169 > 3128), lowering kernel.perf_event_max_sample_rate to 63000
[62972.524128] perf: interrupt took too long (3966 > 3961), lowering kernel.perf_event_max_sample_rate to 50000
[62972.582975] perf: interrupt took too long (5008 > 4957), lowering kernel.perf_event_max_sample_rate to 39000
[62972.782499] perf: interrupt took too long (6675 > 6260), lowering kernel.perf_event_max_sample_rate to 29000
[62973.646071] BUG: unable to handle kernel NULL pointer dereference at 0000000000000004
[62973.646378] IP: [<ffffffffba80328b>] get_segment_base+0x5b/0x80
[62973.646545] PGD 8000001f8d2dc067 PUD 1f9cff3067 PMD 0 
[62973.646702] Oops: 0000 [#1] SMP 
[62973.646853] Modules linked in: fuse btrfs raid6_pq xor vfat msdos fat bridge stp llc tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xfs libcrc32c ib_core amf(POE) mptctl mptbase dmpjbod(POE) dmpap(POE) dmpaa(POE) vxspec(POE) vxio(POE) vxdmp(POE) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache team_mode_activebackup team vxcafs(POE) vxportal(POE) fdd(POE) vxfs(POE) veki(POE) ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul iTCO_wdt iTCO_vendor_support ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops joydev drm i2c_i801 sg hpwdt lpc_ich i2c_core hpilo shpchp wmi acpi_power_meter ipmi_si
[62973.648548]  ipmi_devintf ipmi_msghandler pcc_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables ext4 mbcache jbd2 qla2xxx sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw hpsa be2net scsi_transport_fc scsi_transport_sas scsi_tgt dm_mirror dm_region_hash dm_log dm_mod
[62973.649391] CPU: 11 PID: 17738 Comm: Script60Agent Kdump: loaded Tainted: P        W  OE  ------------   3.10.0-862.6.3.el7.x86_64 #1
[62973.649695] Hardware name: HP ProLiant BL460c Gen9, BIOS I36 05/21/2018
[62973.649855] task: ffff99ce69790fd0 ti: ffff99ce02764000 task.ti: ffff99ce02764000
[62973.650143] RIP: 0010:[<ffffffffba80328b>]  [<ffffffffba80328b>] get_segment_base+0x5b/0x80
[62973.650435] RSP: 0018:ffff99ce7f2c8a60  EFLAGS: 00010046
[62973.650583] RAX: 0000000000000000 RBX: ffff99ce02767f58 RCX: ffff99ce04b63840
[62973.650732] RDX: 0000000000000000 RSI: 0000000000000004 RDI: 0000000000000004
[62973.650881] RBP: ffff99ce7f2c8a60 R08: 0000000000000000 R09: 0000000000000001
[62973.651031] R10: ffff99ccdef32300 R11: 0000000000000000 R12: ffff99ce02767fd8
[62973.651180] R13: ffff99ce72aafc00 R14: ffff99ce69790fd0 R15: 00000000f65f9668
[62973.651341] FS:  0000000000000000(0000) GS:ffff99ce7f2c0000(0063) knlGS:00000000f65ffb40
[62973.651653] CS:  0010 DS: 002b ES: 002b CR0: 0000000080050033
[62973.651824] CR2: 0000000000000004 CR3: 0000001fa4aa4000 CR4: 00000000001607e0
[62973.651974] Call Trace:
[62973.652119]  <NMI> 
[62973.652126]  [<ffffffffba805dfa>] perf_callchain_user+0x1aa/0x280
[62973.652419]  [<ffffffffba98c96e>] get_perf_callchain+0x1ce/0x200
[62973.652567]  [<ffffffffba98ca07>] perf_callchain+0x67/0x90
[62973.652717]  [<ffffffffba987be1>] perf_prepare_sample+0x281/0x380
[62973.652866]  [<ffffffffba987d0f>] perf_event_output_forward+0x2f/0x80
[62973.653029]  [<ffffffffba833919>] ? sched_clock+0x9/0x10
[62973.653188]  [<ffffffffba8d2805>] ? local_clock+0x25/0x30
[62973.653347]  [<ffffffffba97fd37>] __perf_event_overflow+0x57/0x100
[62973.653519]  [<ffffffffba988724>] perf_event_overflow+0x14/0x20
[62973.653668]  [<ffffffffba80a580>] intel_pmu_handle_irq+0x220/0x510
[62973.653839]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.654007]  [<ffffffffbab4d1b4>] ? ioremap_page_range+0x2b4/0x450
[62973.654156]  [<ffffffffba9d7104>] ? vunmap_page_range+0x234/0x470
[62973.654306]  [<ffffffffbac0afb6>] ? ghes_copy_tofrom_phys+0x116/0x210
[62973.654512]  [<ffffffffbac0b150>] ? ghes_read_estatus+0xa0/0x190
[62973.654662]  [<ffffffffbaf17031>] perf_event_nmi_handler+0x31/0x50
[62973.654834]  [<ffffffffbaf188cc>] nmi_handle.isra.0+0x8c/0x150
[62973.655005]  [<ffffffffbaf18aed>] do_nmi+0x15d/0x460
[62973.655152]  [<ffffffffbaf17d69>] end_repeat_nmi+0x1e/0x81
[62973.655301]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.655460]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.655621]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.655792]  <EOE> 
[62973.655798] Code: 
[62973.655967] 02 00 00 7f 3c 48 8b 81 d0 02 00 00 eb 16 66 90 83 fa 10 7f 2c 48 c7 c0 00 c0 00 00 65 48 03 05 1c df 80 45 48 63 d2 48 8d 14 d0 <0f> b6 42 04 0f b6 4a 07 0f b7 52 02 c1 e0 10 c1 e1 18 09 c8 09 
[62973.656638] RIP  [<ffffffffba80328b>] get_segment_base+0x5b/0x80
[62973.656811]  RSP <ffff99ce7f2c8a60>
[62973.656968] CR2: 0000000000000004

Environment

  • Red Hat Enterprise Linux 7
  • Seen on kernel-3.10.0-693.11.6 / kernel-3.10.0-862.6.3.el7

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content