Kernel crashes with a message "FS-Cache: 5 == 3 is false" and "kernel BUG at fs/fscache/operation.c:447!" in Red Hat Enterprise Linux 7

Solution Verified - Updated -

Issue

  • Kernel crashes with following logs :
[2181003.134784] FS-Cache: 
[2181003.138318] FS-Cache: Assertion failed
[2181003.143449] FS-Cache: 5 == 3 is false
[2181003.148506] ------------[ cut here ]------------
[2181003.154544] kernel BUG at fs/fscache/operation.c:447!
[2181003.161078] invalid opcode: 0000 [#1] SMP 
[2181003.166550] Modules linked in: mmfs26(OE) mmfslinux(OE) rpcsec_gss_krb5 nfsv4 dns_resolver tracedev(OE) overlay(T) xfs libcrc32c nfsv3 nfs rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_sa(OE) ib_uverbs(OE) ib_umad(OE) ib_mad(OE) cachefiles fscache mlx5_ib(OE) ib_core(OE) ib_addr(OE) ib_netlink(OE) intel_powerclamp coretemp intel_rapl sd_mod iosf_mbi crc_t10dif crct10dif_generic kvm_intel sg kvm irqbypass crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel iTCO_wdt ghash_clmulni_intel iTCO_vendor_support mxm_wmi mgag200 ttm aesni_intel lrw drm_kms_helper gf128mul glue_helper syscopyarea ablk_helper sysfillrect cryptd sysimgblt mlx5_core(OE) fb_sys_fops drm ahci mei_me libahci sb_edac mei pcspkr i2c_i801 shpchp lpc_ich edac_core libata fjes wmi acpi_power_meter acpi_pad
[2181003.251770]  acpi_cpufreq binfmt_misc knem(OE) nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables tcp_lp ext4 mbcache jbd2 fuse ipmi_si ipmi_devintf ipmi_msghandler gnbd(OE) loop mlx4_en(OE) mlx4_core(OE) mlx_compat(OE) i40e tg3 e1000e e1000 ixgbe mdio igb ptp pps_core i2c_algo_bit i2c_core dca [last unloaded: mlx_compat]
[2181003.285574] CPU: 23 PID: 570735 Comm: kworker/u386:1 Tainted: G           OE  ------------ T 3.10.0-514.el7.x86_64 #1
[2181003.298500] Hardware name: Cray Inc. S2600KPFR/S2600KPFR, BIOS SE5C610.86B.01.01.0015.012820160943 01/28/2016
[2181003.310683] Workqueue: fscache_operation fscache_op_work_func [fscache]
[2181003.319181] task: ffff8836be8f9f60 ti: ffff88296e960000 task.ti: ffff88296e960000
[2181003.328659] RIP: 0010:[<ffffffffa04d0dae>]  [<ffffffffa04d0dae>] fscache_op_complete+0x18e/0x190 [fscache]
[2181003.340614] RSP: 0018:ffff88296e963d70  EFLAGS: 00010246
[2181003.347682] RAX: 0000000000000019 RBX: ffff880d21985b00 RCX: 0000000000000000
[2181003.356791] RDX: 0000000000000000 RSI: ffff883ffde4f838 RDI: ffff883ffde4f838
[2181003.365908] RBP: ffff88296e963d90 R08: 0000000000000092 R09: 00000000000310c9
[2181003.375032] R10: 00000000000003ff R11: 0000000000000001 R12: ffff880e5e606400
[2181003.384152] R13: ffff880e5e606520 R14: ffffea00dbb2bbc0 R15: ffff880d21985b00
[2181003.393284] FS:  0000000000000000(0000) GS:ffff883ffde40000(0000) knlGS:0000000000000000
[2181003.403486] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[2181003.411079] CR2: 00007fafa26c2000 CR3: 00000000019ba000 CR4: 00000000001407e0
[2181003.420235] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[2181003.429388] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[2181003.438529] Stack:
[2181003.441951]  ffff883d4baaeca0 ffff880e5e606400 ffff880e5e606520 ffffea00dbb2bbc0
[2181003.451496]  ffff88296e963e00 ffffffffa0552ec6 ffff88296e963fd8 ffff880d21985b88
[2181003.461045]  0000000800000000 ffff880d21985b00 ffff88296e963fd8 ffff883d4baaec60
[2181003.470605] Call Trace:
[2181003.474552]  [<ffffffffa0552ec6>] cachefiles_read_copier+0x3c6/0x450 [cachefiles]
[2181003.484123]  [<ffffffffa04d0472>] fscache_op_work_func+0x22/0x50 [fscache]
[2181003.493026]  [<ffffffff810a7f3b>] process_one_work+0x17b/0x470
[2181003.500768]  [<ffffffff810a8d76>] worker_thread+0x126/0x410
[2181003.508219]  [<ffffffff810a8c50>] ? rescuer_thread+0x460/0x460
[2181003.515969]  [<ffffffff810b052f>] kthread+0xcf/0xe0
[2181003.522646]  [<ffffffff810b0460>] ? kthread_create_on_node+0x140/0x140
[2181003.531168]  [<ffffffff81696418>] ret_from_fork+0x58/0x90
[2181003.538438]  [<ffffffff810b0460>] ? kthread_create_on_node+0x140/0x140
[2181003.546970] Code: 31 c0 e8 6c e6 1a e1 48 c7 c7 4c 58 4d a0 31 c0 e8 5e e6 1a e1 8b 73 40 ba 03 00 00 00 48 c7 c7 48 4d 4d a0 31 c0 e8 48 e6 1a e1 <0f> 0b 0f 1f 44 00 00 55 48 89 e5 41 56 41 55 41 54 53 8b 47 40 
[2181003.571371] RIP  [<ffffffffa04d0dae>] fscache_op_complete+0x18e/0x190 [fscache]
[2181003.580840]  RSP <ffff88296e963d70>

Environment

  • Red Hat Enterprise Linux 7
  • fscache / cachefiles / NFS

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content