RHEL 7: kernel panic at read_tsc

Solution Verified - Updated -

Issue

  • kernel panic with below logs:

[ 2428.906591] nr_pdflush_threads exported in /proc is scheduled for removal [15760.068891] perf: interrupt took too long (2512 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [16001.735681] perf: interrupt took too long (3149 > 3140), lowering kernel.perf_event_max_sample_rate to 63000 [16410.069237] perf: interrupt took too long (3950 > 3936), lowering kernel.perf_event_max_sample_rate to 50000 [17418.403068] perf: interrupt took too long (4945 > 4937), lowering kernel.perf_event_max_sample_rate to 40000 [87488.524290] perf: interrupt took too long (6183 > 6181), lowering kernel.perf_event_max_sample_rate to 32000 [118415.029455] mount: server fssws1 not responding, timed out [481497.362893] sched: RT throttling activated [1206423.445933] lockd: unexpected unlock status: 7 [1206423.445940] lockd: unexpected unlock status: 7 [1213464.700651] xs_tcp_setup_socket: connect returned unhandled error -107 [1262036.560688] mount: server fssws1 not responding, timed out [1296332.800406] xs_tcp_setup_socket: connect returned unhandled error -107 [1330208.174557] general protection fault: 0000 [#1] SMP [1330208.174580] Modules linked in: nfsv3 nfs fscache bonding rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm dm_mirror dm_region_hash dm_log dm_mod nfit libnvdimm intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd bnxt_re pcspkr ib_core joydev ses enclosure hpwdt hpilo sg ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc sch_fq_codel binfmt_misc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic sr_mod cdrom mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common [1330208.174767] crc32c_intel serio_raw drm ahci igb bnxt_en libahci libata smartpqi ptp pps_core dca scsi_transport_sas devlink i2c_algo_bit drm_panel_orientation_quirks fuse [1330208.174806] CPU: 24 PID: 0 Comm: swapper/24 Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1 [1330208.174825] Hardware name: HPE ProLiant DL360 Gen10 Plus/ProLiant DL360 Gen10 Plus, BIOS U46 05/26/2021 [1330208.174845] task: ffff982866b51080 ti: ffff982866b58000 task.ti: ffff982866b58000 [1330208.174861] RIP: 0010:[<ffffffff81035470>] [<ffffffff81035470>] read_tsc+0x0/0x20 [1330208.174882] RSP: 0018:ffff99243f183f40 EFLAGS: 00010013 [1330208.174894] RAX: ffffffff81035470 RBX: ffffffff81c2f200 RCX: 0000000000000000 [1330208.174909] RDX: ffff99243f19acc0 RSI: 0000000000000001 RDI: ffffffff81c2f200 [1330208.174924] RBP: ffff99243f183f68 R08: 0004bca975effe40 R09: ffff99243f183de0 [1330208.174937] R10: 0000000000000004 R11: 0000000000000005 R12: 0000000000145857 [1330208.174950] R13: 0000000000000000 R14: 000000009d7afcbe R15: ffff982866b58000 [1330208.174963] FS: 0000000000000000(0000) GS:ffff99243f180000(0000) knlGS:0000000000000000 [1330208.174979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [1330208.174992] CR2: 00002b76189fb830 CR3: 0000010602bee000 CR4: 0000000000760fe0 [1330208.175007] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1330208.175019] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [1330208.175031] PKRU: 00000000 [1330208.175037] Call Trace: [1330208.175043] <IRQ> [1330208.175053] [<ffffffff81107602>] ? ktime_get+0x52/0xe0 [1330208.175067] [<ffffffff81110590>] __tick_nohz_idle_enter+0x20/0x170 [1330208.175079] [<ffffffff81110c38>] tick_nohz_irq_exit+0xa8/0xb0 [1330208.175094] [<ffffffff810a4e99>] irq_exit+0x89/0x110 [1330208.175107] [<ffffffff81798a88>] smp_apic_timer_interrupt+0x48/0x60 [1330208.175122] [<ffffffff81794fba>] apic_timer_interrupt+0x16a/0x170 [1330208.175133] <EOI> [1330208.175140] [<ffffffff81789000>] ? __cpuidle_text_start+0x8/0x8 [1330208.175152] [<ffffffff8178924b>] ? native_safe_halt+0xb/0x20 [1330208.175165] [<ffffffff8178901e>] default_idle+0x1e/0xc0 [1330208.175176] [<ffffffff81037ca0>] arch_cpu_idle+0x20/0xc0 [1330208.175187] [<ffffffff811011ea>] cpu_startup_entry+0x14a/0x1e0 [1330208.175199] [<ffffffff8105a7f7>] start_secondary+0x1f7/0x270 [1330208.175211] [<ffffffff810000d5>] start_cpu+0x5/0x14 [1330208.175221] Code: d1 00 48 89 e5 5d c3 0f 1f 40 00 55 8b 05 49 bc d1 00 48 89 e5 5d c3 0f 1f 40 00 55 b8 ed ff ff ff 48 89 e5 5d c3 0f 1f 44 00 00 <55> 48 89 e5 0f ae e8 0f 31 89 c0 48 c1 e2 20 48 09 c2 48 89 d0 [1330208.175291] RIP [<ffffffff81035470>] read_tsc+0x0/0x20 [1330208.175304] RSP <ffff99243f183f40>

Environment

  • Red Hat Enterprise Linux 7
  • kernel-3.10.0-1160.45.1.el7
  • Lenovo ThinkSystem SR630 V2/7Z71CTO1WW, BIOS AFE112B-1.03 07/13/2021
  • HPE ProLiant DL360 Gen10 Plus/ProLiant DL360 Gen10 Plus, BIOS U46 05/26/2021

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content