kernel BUG at fs/fscache/operation.c:70! - FS-Cache: 4 == 5 is false

Solution Verified - Updated -

Issue

  • kernel crashes with following logs:
[ 2259.612361] FS-Cache: 
[ 2259.614785] FS-Cache: Assertion failed
[ 2259.618639] FS-Cache: 4 == 5 is false
[ 2259.622456] ------------[ cut here ]------------
[ 2259.627190] kernel BUG at fs/fscache/operation.c:70!
[ 2259.632292] invalid opcode: 0000 [#1] SMP 
[ 2259.764435] CPU: 77 PID: 40132 Comm: python Kdump: loaded Tainted: P           OE  ------------ T 3.10.0-1062.23.1.el7.x86_64 #1
[ 2259.776303] Hardware name: NVIDIA NVIDIA DGX-2/NVIDIA DGX-2, BIOS 0.24 06/27/2019
[ 2259.783991] task: ffff9fd431c85230 ti: ffff9fd431cb0000 task.ti: ffff9fd431cb0000
[ 2259.791675] RIP: 0010:[<ffffffffc061b4cf>]  [<ffffffffc061b4cf>] fscache_enqueue_operation+0xff/0x170 [fscache]
[ 2259.802059] RSP: 0000:ffffa0263d543be0  EFLAGS: 00010046
[ 2259.807521] RAX: 0000000000000019 RBX: ffffa01a4d390480 RCX: 0000000000000006
[ 2259.814847] RDX: 0000000000000000 RSI: 0000000000000046 RDI: ffffa0263d553890
[ 2259.822176] RBP: ffffa0263d543be8 R08: 0000000000000000 R09: ffffa0263c2d8708
[ 2259.829502] R10: 0000000000001e7f R11: 0000000000000000 R12: ffffa01a4d390480
[ 2259.844483] R13: ffff9fa9546c5920 R14: ffffa0263d543c80 R15: ffffa0293ff9bf10
[ 2259.859554] FS:  00007f4b6efbd700(0000) GS:ffffa0263d540000(0000) knlGS:0000000000000000
[ 2259.875571] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2259.889117] CR2: 00007f49e1624ff0 CR3: 0000012b38b38000 CR4: 00000000007607e0
[ 2259.904015] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 2259.918764] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 2259.933449] PKRU: 55555554
[ 2259.943654] Call Trace:
[ 2259.953592]  <IRQ> 
[ 2259.955577]  [<ffffffffc03a7c12>] cachefiles_read_waiter+0x92/0xf0 [cachefiles]
[ 2259.978039]  [<ffffffffa34d3942>] __wake_up_common+0x82/0x120
[ 2259.991392]  [<ffffffffa34d3a63>] __wake_up_common_lock+0x83/0xc0
[ 2260.004930]  [<ffffffffa34d3510>] ? task_rq_unlock+0x20/0x20
[ 2260.017863]  [<ffffffffa34d3ab3>] __wake_up+0x13/0x20
[ 2260.030230]  [<ffffffffa34c72a0>] __wake_up_bit+0x50/0x70
[ 2260.042535]  [<ffffffffa35bdcdb>] unlock_page+0x2b/0x30
[ 2260.054495]  [<ffffffffa35bdd09>] page_endio+0x29/0x90
[ 2260.066184]  [<ffffffffa368fc81>] mpage_end_io+0x51/0x80
[ 2260.077864]  [<ffffffffa3689de7>] bio_endio+0x67/0xb0
[ 2260.089104]  [<ffffffffa37519d0>] blk_update_request+0x90/0x360
[ 2260.101063]  [<ffffffffa375bb7a>] blk_mq_end_request+0x1a/0x70
[ 2260.112744]  [<ffffffffc00bfd9c>] nvme_complete_rq+0x1c/0xe0 [nvme_core]
[ 2260.125171]  [<ffffffffc0101e70>] nvme_pci_complete_rq+0x50/0x140 [nvme]
[ 2260.137448]  [<ffffffffa375bd26>] __blk_mq_complete_request+0x156/0x1e0
[ 2260.149485]  [<ffffffffa375bdd7>] blk_mq_complete_request+0x27/0x30
[ 2260.161015]  [<ffffffffc01020b2>] nvme_irq+0x152/0x210 [nvme]
[ 2260.171876]  [<ffffffffa354fe14>] __handle_irq_event_percpu+0x44/0x1c0
[ 2260.183454]  [<ffffffffa354ffc2>] handle_irq_event_percpu+0x32/0x80
[ 2260.194660]  [<ffffffffa355004c>] handle_irq_event+0x3c/0x60
[ 2260.205118]  [<ffffffffa3552e3f>] handle_edge_irq+0x7f/0x150
[ 2260.215414]  [<ffffffffa342f5f4>] handle_irq+0xe4/0x1a0
[ 2260.225081]  [<ffffffffa3b9487d>] do_IRQ+0x4d/0xf0
[ 2260.234247]  [<ffffffffa3b8636a>] common_interrupt+0x16a/0x16a
[ 2260.244415]  <EOI> 
[ 2260.246392] Code: 
[ 2260.252695] 31 c0 e8 a7 a6 55 e3 48 c7 c7 b0 08 62 c0 31 c0 e8 99 a6 55 e3 8b 73 40 ba 05 00 00 00 48 c7 c7 a8 fd 61 c0 31 c0 e8 83 a6 55 e3 <0f> 0b 48 c7 c7 a2 08 62 c0 31 c0 e8 73 a6 55 e3 48 c7 c7 b0 08 
[ 2260.285104] RIP  [<ffffffffc061b4cf>] fscache_enqueue_operation+0xff/0x170 [fscache]
[ 2260.297661]  RSP <ffffa0263d543be0>

Environment

  • Red Hat Enterprise Linux 8
  • Red Hat Enterprise Linux 7
  • NFS share mounted with 'fsc' option to enable FS-Cache
  • cachefilesd enabled

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content