Panic in perf_callchain_user -> get_segment_base when running perf record in Red Hat Enterprise Linux 7

Solution Unverified - Updated -

Issue

  • Kernel crashed with following log:
[62972.487886] perf: interrupt took too long (2503 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[62972.501814] perf: interrupt took too long (3169 > 3128), lowering kernel.perf_event_max_sample_rate to 63000
[62972.524128] perf: interrupt took too long (3966 > 3961), lowering kernel.perf_event_max_sample_rate to 50000
[62972.582975] perf: interrupt took too long (5008 > 4957), lowering kernel.perf_event_max_sample_rate to 39000
[62972.782499] perf: interrupt took too long (6675 > 6260), lowering kernel.perf_event_max_sample_rate to 29000
[62973.646071] BUG: unable to handle kernel NULL pointer dereference at 0000000000000004
[62973.646378] IP: [<ffffffffba80328b>] get_segment_base+0x5b/0x80
[62973.646545] PGD 8000001f8d2dc067 PUD 1f9cff3067 PMD 0 
[62973.646702] Oops: 0000 [#1] SMP 
[62973.646853] Modules linked in: fuse btrfs raid6_pq xor vfat msdos fat bridge stp llc tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xfs libcrc32c ib_core amf(POE) mptctl mptbase dmpjbod(POE) dmpap(POE) dmpaa(POE) vxspec(POE) vxio(POE) vxdmp(POE) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache team_mode_activebackup team vxcafs(POE) vxportal(POE) fdd(POE) vxfs(POE) veki(POE) ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul iTCO_wdt iTCO_vendor_support ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr i2c_algo_bit ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops joydev drm i2c_i801 sg hpwdt lpc_ich i2c_core hpilo shpchp wmi acpi_power_meter ipmi_si
[62973.648548]  ipmi_devintf ipmi_msghandler pcc_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables ext4 mbcache jbd2 qla2xxx sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw hpsa be2net scsi_transport_fc scsi_transport_sas scsi_tgt dm_mirror dm_region_hash dm_log dm_mod
[62973.649391] CPU: 11 PID: 17738 Comm: Script60Agent Kdump: loaded Tainted: P        W  OE  ------------   3.10.0-862.6.3.el7.x86_64 #1
[62973.649695] Hardware name: HP ProLiant BL460c Gen9, BIOS I36 05/21/2018
[62973.649855] task: ffff99ce69790fd0 ti: ffff99ce02764000 task.ti: ffff99ce02764000
[62973.650143] RIP: 0010:[<ffffffffba80328b>]  [<ffffffffba80328b>] get_segment_base+0x5b/0x80
[62973.650435] RSP: 0018:ffff99ce7f2c8a60  EFLAGS: 00010046
[62973.650583] RAX: 0000000000000000 RBX: ffff99ce02767f58 RCX: ffff99ce04b63840
[62973.650732] RDX: 0000000000000000 RSI: 0000000000000004 RDI: 0000000000000004
[62973.650881] RBP: ffff99ce7f2c8a60 R08: 0000000000000000 R09: 0000000000000001
[62973.651031] R10: ffff99ccdef32300 R11: 0000000000000000 R12: ffff99ce02767fd8
[62973.651180] R13: ffff99ce72aafc00 R14: ffff99ce69790fd0 R15: 00000000f65f9668
[62973.651341] FS:  0000000000000000(0000) GS:ffff99ce7f2c0000(0063) knlGS:00000000f65ffb40
[62973.651653] CS:  0010 DS: 002b ES: 002b CR0: 0000000080050033
[62973.651824] CR2: 0000000000000004 CR3: 0000001fa4aa4000 CR4: 00000000001607e0
[62973.651974] Call Trace:
[62973.652119]  <NMI> 
[62973.652126]  [<ffffffffba805dfa>] perf_callchain_user+0x1aa/0x280
[62973.652419]  [<ffffffffba98c96e>] get_perf_callchain+0x1ce/0x200
[62973.652567]  [<ffffffffba98ca07>] perf_callchain+0x67/0x90
[62973.652717]  [<ffffffffba987be1>] perf_prepare_sample+0x281/0x380
[62973.652866]  [<ffffffffba987d0f>] perf_event_output_forward+0x2f/0x80
[62973.653029]  [<ffffffffba833919>] ? sched_clock+0x9/0x10
[62973.653188]  [<ffffffffba8d2805>] ? local_clock+0x25/0x30
[62973.653347]  [<ffffffffba97fd37>] __perf_event_overflow+0x57/0x100
[62973.653519]  [<ffffffffba988724>] perf_event_overflow+0x14/0x20
[62973.653668]  [<ffffffffba80a580>] intel_pmu_handle_irq+0x220/0x510
[62973.653839]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.654007]  [<ffffffffbab4d1b4>] ? ioremap_page_range+0x2b4/0x450
[62973.654156]  [<ffffffffba9d7104>] ? vunmap_page_range+0x234/0x470
[62973.654306]  [<ffffffffbac0afb6>] ? ghes_copy_tofrom_phys+0x116/0x210
[62973.654512]  [<ffffffffbac0b150>] ? ghes_read_estatus+0xa0/0x190
[62973.654662]  [<ffffffffbaf17031>] perf_event_nmi_handler+0x31/0x50
[62973.654834]  [<ffffffffbaf188cc>] nmi_handle.isra.0+0x8c/0x150
[62973.655005]  [<ffffffffbaf18aed>] do_nmi+0x15d/0x460
[62973.655152]  [<ffffffffbaf17d69>] end_repeat_nmi+0x1e/0x81
[62973.655301]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.655460]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.655621]  [<ffffffffbaf244cc>] ? ia32_sysenter_target+0xbc/0x141
[62973.655792]  <EOE> 
[62973.655798] Code: 
[62973.655967] 02 00 00 7f 3c 48 8b 81 d0 02 00 00 eb 16 66 90 83 fa 10 7f 2c 48 c7 c0 00 c0 00 00 65 48 03 05 1c df 80 45 48 63 d2 48 8d 14 d0 <0f> b6 42 04 0f b6 4a 07 0f b7 52 02 c1 e0 10 c1 e1 18 09 c8 09 
[62973.656638] RIP  [<ffffffffba80328b>] get_segment_base+0x5b/0x80
[62973.656811]  RSP <ffff99ce7f2c8a60>
[62973.656968] CR2: 0000000000000004

Environment

  • Red Hat Enterprise Linux 7
  • Seen on kernel-3.10.0-693.11.6 / kernel-3.10.0-862.6.3.el7

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In