RHEL 7: kernel panic at read_tsc
Issue
- kernel panic with below logs:
[ 2428.906591] nr_pdflush_threads exported in /proc is scheduled for removal
[15760.068891] perf: interrupt took too long (2512 > 2500), lowering kernel.perf_event_max_sample_rate to 79000
[16001.735681] perf: interrupt took too long (3149 > 3140), lowering kernel.perf_event_max_sample_rate to 63000
[16410.069237] perf: interrupt took too long (3950 > 3936), lowering kernel.perf_event_max_sample_rate to 50000
[17418.403068] perf: interrupt took too long (4945 > 4937), lowering kernel.perf_event_max_sample_rate to 40000
[87488.524290] perf: interrupt took too long (6183 > 6181), lowering kernel.perf_event_max_sample_rate to 32000
[118415.029455] mount: server fssws1 not responding, timed out
[481497.362893] sched: RT throttling activated
[1206423.445933] lockd: unexpected unlock status: 7
[1206423.445940] lockd: unexpected unlock status: 7
[1213464.700651] xs_tcp_setup_socket: connect returned unhandled error -107
[1262036.560688] mount: server fssws1 not responding, timed out
[1296332.800406] xs_tcp_setup_socket: connect returned unhandled error -107
[1330208.174557] general protection fault: 0000 [#1] SMP
[1330208.174580] Modules linked in: nfsv3 nfs fscache bonding rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm dm_mirror dm_region_hash dm_log dm_mod nfit libnvdimm intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd bnxt_re pcspkr ib_core joydev ses enclosure hpwdt hpilo sg ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc sch_fq_codel binfmt_misc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic sr_mod cdrom mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common
[1330208.174767] crc32c_intel serio_raw drm ahci igb bnxt_en libahci libata smartpqi ptp pps_core dca scsi_transport_sas devlink i2c_algo_bit drm_panel_orientation_quirks fuse
[1330208.174806] CPU: 24 PID: 0 Comm: swapper/24 Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
[1330208.174825] Hardware name: HPE ProLiant DL360 Gen10 Plus/ProLiant DL360 Gen10 Plus, BIOS U46 05/26/2021
[1330208.174845] task: ffff982866b51080 ti: ffff982866b58000 task.ti: ffff982866b58000
[1330208.174861] RIP: 0010:[<ffffffff81035470>] [<ffffffff81035470>] read_tsc+0x0/0x20
[1330208.174882] RSP: 0018:ffff99243f183f40 EFLAGS: 00010013
[1330208.174894] RAX: ffffffff81035470 RBX: ffffffff81c2f200 RCX: 0000000000000000
[1330208.174909] RDX: ffff99243f19acc0 RSI: 0000000000000001 RDI: ffffffff81c2f200
[1330208.174924] RBP: ffff99243f183f68 R08: 0004bca975effe40 R09: ffff99243f183de0
[1330208.174937] R10: 0000000000000004 R11: 0000000000000005 R12: 0000000000145857
[1330208.174950] R13: 0000000000000000 R14: 000000009d7afcbe R15: ffff982866b58000
[1330208.174963] FS: 0000000000000000(0000) GS:ffff99243f180000(0000) knlGS:0000000000000000
[1330208.174979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[1330208.174992] CR2: 00002b76189fb830 CR3: 0000010602bee000 CR4: 0000000000760fe0
[1330208.175007] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[1330208.175019] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[1330208.175031] PKRU: 00000000
[1330208.175037] Call Trace:
[1330208.175043] <IRQ>
[1330208.175053] [<ffffffff81107602>] ? ktime_get+0x52/0xe0
[1330208.175067] [<ffffffff81110590>] __tick_nohz_idle_enter+0x20/0x170
[1330208.175079] [<ffffffff81110c38>] tick_nohz_irq_exit+0xa8/0xb0
[1330208.175094] [<ffffffff810a4e99>] irq_exit+0x89/0x110
[1330208.175107] [<ffffffff81798a88>] smp_apic_timer_interrupt+0x48/0x60
[1330208.175122] [<ffffffff81794fba>] apic_timer_interrupt+0x16a/0x170
[1330208.175133] <EOI>
[1330208.175140] [<ffffffff81789000>] ? __cpuidle_text_start+0x8/0x8
[1330208.175152] [<ffffffff8178924b>] ? native_safe_halt+0xb/0x20
[1330208.175165] [<ffffffff8178901e>] default_idle+0x1e/0xc0
[1330208.175176] [<ffffffff81037ca0>] arch_cpu_idle+0x20/0xc0
[1330208.175187] [<ffffffff811011ea>] cpu_startup_entry+0x14a/0x1e0
[1330208.175199] [<ffffffff8105a7f7>] start_secondary+0x1f7/0x270
[1330208.175211] [<ffffffff810000d5>] start_cpu+0x5/0x14
[1330208.175221] Code: d1 00 48 89 e5 5d c3 0f 1f 40 00 55 8b 05 49 bc d1 00 48 89 e5 5d c3 0f 1f 40 00 55 b8 ed ff ff ff 48 89 e5 5d c3 0f 1f 44 00 00 <55> 48 89 e5 0f ae e8 0f 31 89 c0 48 c1 e2 20 48 09 c2 48 89 d0
[1330208.175291] RIP [<ffffffff81035470>] read_tsc+0x0/0x20
[1330208.175304] RSP <ffff99243f183f40>
Environment
- Red Hat Enterprise Linux 7
- kernel-3.10.0-1160.45.1.el7
- Lenovo ThinkSystem SR630 V2/7Z71CTO1WW, BIOS AFE112B-1.03 07/13/2021
- HPE ProLiant DL360 Gen10 Plus/ProLiant DL360 Gen10 Plus, BIOS U46 05/26/2021
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.