kernel BUG at lib/list_debug.c:x due to vx_ddelete().

Solution Verified - Updated -

Issue

  • Kernel crashed with the following logs:
[34348.069429] list_del corruption. next->prev should be ffff903a66a81660, but was ffff903970e75520
[34348.069683] ------------[ cut here ]------------
[34348.069687] kernel BUG at lib/list_debug.c:56!
[34348.069748] invalid opcode: 0000 [#1] SMP PTI
[34348.069797] CPU: 3 PID: 68546 Comm: scheduling-28 Kdump: loaded Tainted: P           OE     -------- -  - 4.18.0-553.60.1.el8_10.x86_64 #1
[34348.069927] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
[34348.070038] RIP: 0010:__list_del_entry_valid.cold.1+0x20/0x48
[34348.070125] Code: 51 94 b2 e8 fe 40 c7 ff 0f 0b 48 89 fe 48 89 c2 48 c7 c7 c8 51 94 b2 e8 ea 40 c7 ff 0f 0b 48 c7 c7 78 52 94 b2 e8 dc 40 c7 ff <0f> 0b 48 89 f2 48 89 fe 48 c7 c7 38 52 94 b2 e8 c8 40 c7 ff 0f 0b
[34348.070323] RSP: 0018:ffffb4061587be10 EFLAGS: 00010246
[34348.070380] RAX: 0000000000000054 RBX: ffff903a66a81660 RCX: 0000000000000000
[34348.070453] RDX: 0000000000000000 RSI: ffff90434dede698 RDI: ffff90434dede698
[34348.070526] RBP: ffff90396ddca0c0 R08: 0000000000000000 R09: c0000000ffff7fff
[34348.070599] R10: 0000000000000001 R11: ffffb4061587bc30 R12: 0000000000000049
[34348.070672] R13: ffff9039ea975c38 R14: ffffffffc0afc0f8 R15: ffffffffc0afc108
[34348.070746] FS:  00007f5d669eb700(0000) GS:ffff90434dec0000(0000) knlGS:0000000000000000
[34348.070831] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[34348.070891] CR2: 00007f26069df720 CR3: 000000037b83a005 CR4: 00000000007706e0
[34348.070980] PKRU: 55555554
[34348.071010] Call Trace:
[34348.071049]  ? __die_body+0x1a/0x60
[34348.071098]  ? die+0x2a/0x50
[34348.071130]  ? do_trap+0xe7/0x110
[34348.071167]  ? __list_del_entry_valid.cold.1+0x20/0x48
[34348.071221]  ? do_invalid_op+0x36/0x40
[34348.071261]  ? __list_del_entry_valid.cold.1+0x20/0x48
[34348.071315]  ? invalid_op+0x14/0x20
[34348.071373]  ? __list_del_entry_valid.cold.1+0x20/0x48
[34348.071427]  vx_ddelete+0x9e/0x2a0 [vxfs]
[34348.071592]  dput.part.33+0x120/0x150
[34348.071651]  do_renameat2+0x3a3/0x510
[34348.071700]  __x64_sys_rename+0x1c/0x30
[34348.071743]  do_syscall_64+0x5b/0x1a0
[34348.071798]  entry_SYSCALL_64_after_hwframe+0x66/0xcb
[34348.071861] RIP: 0033:0x7f5e0fd1e6cb
[34348.071903] Code: e8 ba 5a fb ff 85 c0 0f 95 c0 0f b6 c0 f7 d8 5b c3 66 0f 1f 44 00 00 b8 ff ff ff ff 5b c3 90 f3 0f 1e fa b8 52 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 05 c3 0f 1f 40 00 48 8b 15 89 d7 34 00 f7 d8
[34348.072098] RSP: 002b:00007f5d669ea618 EFLAGS: 00000206 ORIG_RAX: 0000000000000052
  • Similar calltraces were reported.
[91820.795078] kernel BUG at lib/list_debug.c:51!
[91820.795554] invalid opcode: 0000 [#1] PREEMPT SMP PTI
[91820.795557] CPU: 0 PID: 2344590 Comm: bpdbm Kdump: loaded Tainted: P           OE     -------  ---  5.14.0-570.30.1.el9_6.x86_64 #1
[91820.795560] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.21100432.B64.2301110304 01/11/2023
[91820.795561] RIP: 0010:__list_del_entry_valid.cold+0x31/0x47
[91820.795570] Code: 44 8d a3 e8 fb 69 fe ff 0f 0b 48 c7 c7 10 45 8d a3 e8 ed 69 fe ff 0f 0b 48 89 f2 48 89 fe 48 c7 c7 d0 44 8d a3 e8 d9 69 fe ff <0f> 0b 48 89 fe 4c 89 c2 48 c7 c7 98 44 8d a3 e8 c5 69 fe ff 0f 0b
[91820.795573] RSP: 0018:ffffad72844bbbc8 EFLAGS: 00010246
[91820.795575] RAX: 0000000000000054 RBX: ffffa08ef5d5e200 RCX: 0000000000000000
[91820.795576] RDX: 0000000000000000 RSI: ffffa0a19da208c0 RDI: ffffa0a19da208c0
[91820.795578] RBP: ffffa0913b5c2240 R08: 0000000000000000 R09: ffffad72844bba88
[91820.795579] R10: ffffad72844bba80 R11: ffffffffa43b95c8 R12: 0000000000000077
[91820.795580] R13: ffffffffc1ded848 R14: ffffa08bf21354a8 R15: ffffffffc1ded858
[91820.795581] FS:  00007f08d42ed8c0(0000) GS:ffffa0a19da00000(0000) knlGS:0000000000000000
[91820.795583] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[91820.795584] CR2: 0000562378b63000 CR3: 000000057348a001 CR4: 00000000007706f0
[91820.795607] PKRU: 55555554
[91820.795608] Call Trace:
[91820.795610]  <TASK>
[91820.795612]  ? show_trace_log_lvl+0x1c4/0x2df
[91820.795618]  ? show_trace_log_lvl+0x1c4/0x2df
[91820.795624]  ? vx_ddelete+0x9e/0x2a0 [vxfs]
[91820.795848]  ? __die_body.cold+0x8/0xd
[91820.795851]  ? die+0x2b/0x50
[91820.795855]  ? do_trap+0xce/0x120
[91820.795858]  ? __list_del_entry_valid.cold+0x31/0x47
[91820.795861]  ? do_error_trap+0x65/0x80
[91820.795863]  ? __list_del_entry_valid.cold+0x31/0x47
[91820.795865]  ? exc_invalid_op+0x4e/0x70
[91820.795868]  ? __list_del_entry_valid.cold+0x31/0x47
[91820.795870]  ? asm_exc_invalid_op+0x16/0x20
[260752.427013] kernel BUG at lib/list_debug.c:26!
[260752.427029] invalid opcode: 0000 [#1] PREEMPT SMP PTI
[260752.427031] CPU: 13 PID: 2184814 Comm: /usr/openv/netb Kdump: loaded Tainted: P           OE     -------  ---  5.14.0-570.30.1.el9_6.x86_64 #1
[260752.427034] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.21100432.B64.2301110304 01/11/2023
[260752.427036] RIP: 0010:__list_add_valid.cold+0x3d/0x3f
[260752.427045] Code: f2 4c 89 c1 48 89 fe 48 c7 c7 28 44 4d ad e8 23 6a fe ff 0f 0b 48 89 d1 4c 89 c6 4c 89 ca 48 c7 c7 d0 43 4d ad e8 0c 6a fe ff <0f> 0b 48 89 fe 48 c7 c7 60 44 4d ad e
8 fb 69 fe ff 0f 0b 48 c7 c7
[260752.427047] RSP: 0018:ffffa3a33bb9fd30 EFLAGS: 00010246
[260752.427049] RAX: 0000000000000075 RBX: ffff91b81261f4c0 RCX: 0000000000000000
[260752.427051] RDX: 0000000000000000 RSI: ffff91cb9dd608c0 RDI: ffff91cb9dd608c0
[260752.427052] RBP: ffff91bce9868840 R08: 0000000000000000 R09: ffffa3a33bb9fbf0
[260752.427053] R10: ffffa3a33bb9fbe8 R11: ffffffffadf246f0 R12: 0000000000000030
[260752.427054] R13: ffffffffc1f4f1a0 R14: ffff91b4871674a8 R15: ffffffffc1f4f1b0
[260752.427055] FS:  00007f5ec834a740(0000) GS:ffff91cb9dd40000(0000) knlGS:0000000000000000
[260752.427057] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[260752.427059] CR2: 00007f45eddf59d8 CR3: 00000008432cc004 CR4: 00000000007706f0
[260752.427081] PKRU: 55555554
[260752.427082] Call Trace:
[260752.427085]  <TASK>
[260752.427087]  ? show_trace_log_lvl+0x1c4/0x2df
[260752.427092]  ? show_trace_log_lvl+0x1c4/0x2df
[260752.427098]  ? vx_ddelete+0x247/0x2a0 [vxfs]
[260752.427288]  ? __die_body.cold+0x8/0xd
[260752.427291]  ? die+0x2b/0x50
[260752.427296]  ? do_trap+0xce/0x120
[260752.427299]  ? __list_add_valid.cold+0x3d/0x3f
[260752.427305]  ? do_error_trap+0x65/0x80
[260752.427307]  ? __list_add_valid.cold+0x3d/0x3f
[260752.427310]  ? exc_invalid_op+0x4e/0x70
[260752.427313]  ? __list_add_valid.cold+0x3d/0x3f
[260752.427315]  ? asm_exc_invalid_op+0x16/0x20
[260752.427322]  ? __list_add_valid.cold+0x3d/0x3f
[260752.427324]  vx_ddelete+0x247/0x2a0 [vxfs]
[260752.427460]  dput+0x162/0x1a0
[260752.427466]  path_put+0x12/0x20
[260752.427470]  vfs_statx+0xf9/0x160
[260752.427474]  vfs_fstatat+0x54/0x70
[260752.427477]  __do_sys_newlstat+0x33/0x70
[260752.427480]  do_syscall_64+0x5c/0xe0

Environment

  • Red Hat Enterprise Linux
  • 3rd party module [vxfs], version 8.0.2.2700

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content