Since upgraded from 4.18.0-372.32.1.el8_6, system failed to boot to new installed kernel 4.18.0-477.13.1.el8_8

Solution Unverified - Updated -

Issue

  • System not booting properly with the below log.
...
[  102.834700] LLT INFO V-14-1-10510 sent hbreq (NULL) on link 1 (eno7) node 0. 1 more to go.
[  102.937698] LLT INFO V-14-1-10032 link 1 (eno7) node 0 inactive 15 sec (1045)
[  103.243694] LLT INFO V-14-1-10510 sent hbreq (NULL) on link 1 (eno7) node 0. 0 more to go.
[  103.652686] LLT INFO V-14-1-10509 link 1 (eno7) node 0 expired
[  103.806681] LLT INFO V-14-1-10205 link 2 (team0) node 0 in trouble
[  105.427272] NMI watchdog: Watchdog detected hard LOCKUP on cpu 6Modules linked in: vxfen(POE) vxglm(POE) gab(POE) dmpaa(POE) llt(POE) vxspec(POE) vxio(POE) vxdmp(POE) vxcafs(POE) vxportal(POE) fdd(POE) amf(POE) rdma_cm iw_cm ib_cm ib_core vxfs(POE) veki(POE) xfs dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c sd_mod sg qla2xxx crc32c_intel serio_raw hpsa nvme_fc nvme_fabrics i40e nvme_core smartpqi scsi_transport_sas t10_pi scsi_transport_fc tg3 dm_mirror dm_region_hash dm_log dm_mod
[  105.427287] CPU: 6 PID: 50766 Comm: ps Kdump: loaded Tainted: P           OE    --------- -  - 4.18.0-477.13.1.el8_8.x86_64 #1
[  105.427288] Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 05/17/2022
[  105.427289] RIP: 0010:native_queued_spin_lock_slowpath+0x17b/0x1c0
[  105.427290] Code: 74 22 48 89 c1 0f 0d 08 eb 20 f3 90 8b 07 85 c0 75 f8 f0 0f b1 17 75 f2 65 ff 0d 2c 8d ed 5b e9 9b 64 ca 00 31 c9 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c6 74 20 c6 07 01
[  105.427290] RSP: 0018:ffffae889fc6bce0 EFLAGS: 00000002
[  105.427291] RAX: 0000000000280101 RBX: 0000000000000282 RCX: 0000000000000000
[  105.427292] RDX: ffff90b3bb2b3cc0 RSI: 00000000001c0000 RDI: ffff90554f743148
[  105.427292] RBP: ffff90747d2c8000 R08: 0000000000000001 R09: 0000000000000000
[  105.427292] R10: ffff905550ec5000 R11: 0000000000000001 R12: ffff90554f743148
[  105.427293] R13: ffffae889fc6bdf0 R14: ffffffffa5a5c380 R15: 0000000000000001
[  105.427293] FS:  00007fec725f0940(0000) GS:ffff90b3bb280000(0000) knlGS:0000000000000000
[  105.427294] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  105.427294] CR2: 0000561ebe7be0e8 CR3: 0000008b5297c001 CR4: 00000000007706e0
[  105.427294] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  105.427295] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  105.427295] PKRU: 55555554
[  105.427295] Call Trace:
[  105.427296]  _raw_spin_lock_irqsave+0x34/0x40
[  105.427296]  __lock_task_sighand+0x2c/0x70
[  105.427296]  do_task_stat+0xae6/0xe20
[  105.427297]  ? __mod_memcg_lruvec_state+0x4a/0xc0
[  105.427297]  ? mod_objcg_state+0x118/0x260
[  105.427297]  proc_single_show+0x4e/0xa0
[  105.427297]  seq_read+0x163/0x420
[  105.427298]  vfs_read+0x91/0x150
[  105.427298]  ksys_read+0x4f/0xb0
[  105.427298]  do_syscall_64+0x5b/0x1b0
[  105.427299]  entry_SYSCALL_64_after_hwframe+0x61/0xc6
[  105.427299] RIP: 0033:0x7fec719b6985
[  105.427299] Code: fe ff ff 50 48 8d 3d 12 ca 06 00 e8 65 ed 01 00 0f 1f 44 00 00 f3 0f 1e fa 48 8d 05 b5 4d 2a 00 8b 00 85 c0 75 0f 31 c0 0f 05 <48> 3d 00 f0 ff ff 77 53 c3 66 90 41 54 49 89 d4 55 48 89 f5 53 89
[  105.427300] RSP: 002b:00007ffde592f218 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[  105.427301] RAX: ffffffffffffffda RBX: 00007fec723bf678 RCX: 00007fec719b6985
[  105.427301] RDX: 0000000000000800 RSI: 0000561ebe7b3710 RDI: 0000000000000006
[  105.427301] RBP: 00007fec723bf670 R08: 0000000000000000 R09: 00007fec71a16ae0
[  105.427302] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000006
[  105.427302] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
...

Environment

  • Red Hat Enterprise Linux 8.8 (4.18.0-477.13.1.el8_8.x86_64)
  • Veritas filesystem is in use

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content