Kernel panic at RIP try_to_free_buffers

Solution Verified - Updated -

Issue

  • Copying files to FAT FS on a NVDIMM device causes a kernel crash.
  • kernel BUG at fs/buffer.c:3244!
  • kernel BUG at fs/buffer.c:3177!
  • Kernel panics with following messages:
[  143.385283] ------------[ cut here ]------------
[  143.406972] kernel BUG at fs/buffer.c:3177!
[  143.426808] invalid opcode: 0000 [#1] SMP
 :
[  144.668298] Call Trace:
[  144.680086]  [<ffffffff812428ae>] clean_buffers+0x4e/0x60
[  144.705059]  [<ffffffff8124377f>] __mpage_writepage+0x59f/0x6c0
[  144.733321]  [<ffffffff81182d11>] ? find_get_pages_tag+0xe1/0x1a0
[  144.762418]  [<ffffffff8118dc21>] write_cache_pages+0x251/0x4d0
[  144.790649]  [<ffffffff812431e0>] ? mpage_readpage+0x90/0x90
[  144.817813]  [<ffffffffc057f360>] ? fat_detach+0xe0/0xe0 [fat]
[  144.845830]  [<ffffffff81242809>] mpage_writepages+0x69/0xc0
[  144.873260]  [<ffffffffc057f360>] ? fat_detach+0xe0/0xe0 [fat]
[  144.901300]  [<ffffffffc057f615>] fat_writepages+0x15/0x20 [fat]
[  144.930020]  [<ffffffff8118ef8e>] do_writepages+0x1e/0x40
[  144.955747]  [<ffffffff8122d810>] __writeback_single_inode+0x40/0x220
[  144.986741]  [<ffffffff8122e454>] writeback_sb_inodes+0x1c4/0x490
[  145.016602]  [<ffffffff8122e7bf>] __writeback_inodes_wb+0x9f/0xd0
[  145.046471]  [<ffffffff8122eff3>] wb_writeback+0x263/0x2f0
[  145.073457]  [<ffffffff8122f39c>] bdi_writeback_workfn+0x1cc/0x460
[  145.103732]  [<ffffffff810a885a>] process_one_work+0x17a/0x440
[  145.132716]  [<ffffffff810a9526>] worker_thread+0x126/0x3c0
[  145.160198]  [<ffffffff810a9400>] ? manage_workers.isra.24+0x2a0/0x2a0
[  145.192413]  [<ffffffff810b09cf>] kthread+0xcf/0xe0
[  145.216640]  [<ffffffff810b0900>] ? insert_kthread_work+0x40/0x40
[  145.246367]  [<ffffffff816b5ed8>] ret_from_fork+0x58/0x90
[  145.272051]  [<ffffffff810b0900>] ? insert_kthread_work+0x40/0x40
[  145.301701] Code: 00 00 00 00 00 be 00 10 00 00 48 89 df e8 03 b8 f5 ff eb a1 90 48 8d 75 d8 48 89 df e8 c4 f2 ff ff 41 89 c5 eb 99 e8 5a 13 e5 ff <0f> 0b 0f 1f 84 00 00 00 00 00 f0 0f ba 2f 02 19 d2 31 c0 85 d2
[  145.394713] RIP  [<ffffffff81236406>] try_to_free_buffers+0xe6/0xf0
[  145.425046]  RSP <ffff880c6da97888>
[  145.444961] ---[ end trace 7823af9ae2ddf5fd ]---
[  277.826442] ------------[ cut here ]------------
[  277.849723] kernel BUG at fs/buffer.c:3244!
[  277.870625] invalid opcode: 0000 [#1] SMP
[  277.889817] Modules linked in: vfat fat xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper dax_pmem iTCO_wdt nd_pmem iTCO_vendor_support hpilo sg cryptd dax nd_btt hpwdt nd_e820 ipmi_si wmi pcspkr i2c_i801 ioatdma libnvdimm lpc_ich ipmi_devintf shpchp dca pcc_cpufreq ipmi_msghandler acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace binfmt_misc sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200
[  278.220670]  i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm tg3 ptp crct10dif_pclmul crct10dif_common serio_raw hpsa crc32c_intel i2c_core pps_core scsi_transport_sas dm_mirror dm_region_hash dm_log dm_mod
[  278.314656] CPU: 12 PID: 276 Comm: kworker/u66:1 Not tainted 3.10.0-804.el7.x86_64 #1
[  278.351488] Hardware name: HP ProLiant DL360 Gen9, BIOS P89 05/06/2015
[  278.383058] Workqueue: writeback bdi_writeback_workfn (flush-259:0)
[  278.413625] task: ffffa0653f638000 ti: ffffa0653ef7c000 task.ti: ffffa0653ef7c000
[  278.450002] RIP: 0010:[<ffffffffa3c49fc6>]  [<ffffffffa3c49fc6>] try_to_free_buffers+0xe6/0xf0
[  278.493535] RSP: 0018:ffffa0653ef7f880  EFLAGS: 00010246
[  278.518655] RAX: 006fffff0000086c RBX: fffff2dd41480480 RCX: ffffa067d0b0ebc8
[  278.553651] RDX: 0000000000000008 RSI: 0000000000000008 RDI: ffffa067d09e01d0
[  278.587433] RBP: ffffa0653ef7f8a8 R08: 2400000000000000 R09: cb75052012000000
[  278.621436] R10: 348aedbd2f480480 R11: 0000000000000000 R12: fffff2dd41480480
[  278.658955] R13: 0000000000001000 R14: ffffa0653ef7fb20 R15: 0000000000004022
[  278.693987] FS:  0000000000000000(0000) GS:ffffa067e7300000(0000) knlGS:0000000000000000
[  278.734985] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  278.762317] CR2: 00007f76cee563f0 CR3: 0000000dbf40e000 CR4: 00000000001407e0
[  278.796444] Call Trace:
[  278.808820] Code: 00 00 00 00 00 be 00 10 00 00 48 89 df e8 63 33 f5 ff eb a1 90 48 8d 75 d8 48 89 df e8 c4 f2 ff ff 41 89 c5 eb 99 e8 aa 30 e4 ff <0f> 0b 0f 1f 84 00 00 00 00 00 f0 0f ba 2f 02 19 d2 31 c0 85 d2
[  278.911418] RIP  [<ffffffffa3c49fc6>] try_to_free_buffers+0xe6/0xf0
[  278.942011]  RSP <ffffa0653ef7f880>

Environment

  • Red Hat Enterprise Linux 7
  • Non-volatile dual in-line memory module (NVDIMM)
  • FAT FS

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In