Frequent kernel panics in mem_cgroup_update_file_mapped

Solution Verified - Updated -

Issue

  • Experiencing kernel WARNINGs followed by full kernel panics with the following signature:
------------[ cut here ]------------
WARNING: at kernel/cgroup.c:4052 __css_put+0x70/0x80() (Not tainted)
Hardware name: PowerEdge C2100       
Modules linked in: fuse bonding 8021q garp stp llc autofs4 sunrpc ipv6 dm_mirror dm_region_hash dm_log sg dcdbas serio_raw i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support igb dca i7core_edac edac_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif megaraid_sas pata_acpi ata_generic ata_piix dm_mod [last unloaded: microcode]
Pid: 7883, comm: postgres Not tainted 2.6.32-279.22.1.el6.x86_64 #1
Call Trace:
 [<ffffffff8106a2a7>] ? warn_slowpath_common+0x87/0xc0
 [<ffffffff8106a2fa>] ? warn_slowpath_null+0x1a/0x20
 [<ffffffff810bf4b0>] ? __css_put+0x70/0x80
 [<ffffffff810bf4ec>] ? cgroup_release_and_wakeup_rmdir+0x2c/0x40
 [<ffffffff8116b7e1>] ? __mem_cgroup_commit_charge_swapin+0x181/0x230
 [<ffffffff8116ba09>] ? mem_cgroup_cache_charge+0x89/0x130
 [<ffffffff8111045a>] ? add_to_page_cache_locked+0x4a/0x140
 [<ffffffff811301be>] ? shmem_getpage+0x32e/0x9f0
 [<ffffffff811308cd>] ? shmem_fault+0x4d/0x70
 [<ffffffff811fea7e>] ? shm_fault+0x1e/0x20
 [<ffffffff8113a994>] ? __do_fault+0x54/0x510
 [<ffffffff8113af47>] ? handle_pte_fault+0xf7/0xb50
 [<ffffffffa008acc2>] ? ext4_get_blocks+0x192/0x2a0 [ext4]
 [<ffffffff8113bbda>] ? handle_mm_fault+0x23a/0x310
 [<ffffffff810432d9>] ? __do_page_fault+0x139/0x480
 [<ffffffff811a8b17>] ? __set_page_dirty+0x87/0xf0
 [<ffffffff81052223>] ? __wake_up+0x53/0x70
 [<ffffffff814efa4e>] ? do_page_fault+0x3e/0xa0
 [<ffffffff8110f1ac>] ? iov_iter_fault_in_readable+0x4c/0x60
 [<ffffffff811109a2>] ? generic_file_buffered_write+0xf2/0x2e0
 [<ffffffff81112370>] ? __generic_file_aio_write+0x250/0x480
 [<ffffffff8111260f>] ? generic_file_aio_write+0x6f/0xe0
 [<ffffffffa00840b1>] ? ext4_file_write+0x61/0x1e0 [ext4]
 [<ffffffff811764ca>] ? do_sync_write+0xfa/0x140
 [<ffffffff81090be0>] ? autoremove_wake_function+0x0/0x40
 [<ffffffff8118ef4a>] ? dput+0x9a/0x150
 [<ffffffff8120cd06>] ? security_file_permission+0x16/0x20
 [<ffffffff811767c8>] ? vfs_write+0xb8/0x1a0
 [<ffffffff811770c1>] ? sys_write+0x51/0x90
 [<ffffffff810d3c95>] ? __audit_syscall_exit+0x265/0x290
 [<ffffffff8100b072>] ? system_call_fastpath+0x16/0x1b
---[ end trace 137bc36ff7a609a4 ]---
BUG: unable to handle kernel paging request at ffffc90019514410
IP: [<ffffffff8116a682>] mem_cgroup_update_file_mapped+0x52/0x90
PGD c3feb8067 PUD c3feb9067 PMD 8773e3067 PTE 0
Oops: 0002 [#1] SMP 
last sysfs file: /sys/devices/system/cpu/cpu23/cache/index2/shared_cpu_map
CPU 12 
Modules linked in: fuse bonding 8021q garp stp llc autofs4 sunrpc ipv6 dm_mirror dm_region_hash dm_log sg dcdbas serio_raw i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support igb dca i7core_edac edac_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif megaraid_sas pata_acpi ata_generic ata_piix dm_mod [last unloaded: microcode]

Pid: 7883, comm: postgres Tainted: G        W  ---------------    2.6.32-279.22.1.el6.x86_64 #1 Dell                   PowerEdge C2100       /0P19C9
RIP: 0010:[<ffffffff8116a682>]  [<ffffffff8116a682>] mem_cgroup_update_file_mapped+0x52/0x90
RSP: 0018:ffff880b8b457c98  EFLAGS: 00010206
RAX: ffff880c2c37f0c0 RBX: ffffea00237de550 RCX: 0000000000000300
RDX: ffffc90019513000 RSI: ffffffffffffffff RDI: 000000001447f0c0
RBP: ffff880b8b457ca8 R08: 0000000000000064 R09: 0000000000000000
R10: ffff880028407d00 R11: 0000000000000000 R12: 00000000ffffffff
R13: ffff880bada62850 R14: 00000000002bbdcd R15: ffff8808770311a8
FS:  0000000000000000(0000) GS:ffff880053780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffc90019514410 CR3: 0000000001a85000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process postgres (pid: 7883, threadinfo ffff880b8b456000, task ffff880c15cc2080)
Stack:
 ffffea00237de550 00007f88a1600000 ffff880b8b457cc8 ffffffff81143faa
<d> 0000000000400000 00007f88a1435000 ffff880b8b457e08 ffffffff81138ed6
<d> 0000000000000000 0000000000000000 ffff880b8b457d18 ffffffff00000025
Call Trace:
 [<ffffffff81143faa>] page_remove_rmap+0x7a/0xa0
 [<ffffffff81138ed6>] unmap_vmas+0x706/0xc30
 [<ffffffff8113e9d7>] exit_mmap+0x87/0x170
 [<ffffffff810674dc>] mmput+0x6c/0x120
 [<ffffffff8106eceb>] exit_mm+0x12b/0x180
 [<ffffffff8106f09f>] do_exit+0x15f/0x870
 [<ffffffff8106f808>] do_group_exit+0x58/0xd0
 [<ffffffff8106f897>] sys_exit_group+0x17/0x20
 [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
Code: 48 8b 50 08 48 85 d2 74 05 f6 00 04 75 0b f0 80 20 fe 5b 41 5c c9 c3 66 90 65 8b 0c 25 b8 e0 00 00 48 63 c9 49 63 f4 48 c1 e1 06 <48> 01 b4 0a 10 11 00 00 45 85 e4 7e 09 f0 80 08 10 eb d0 0f 1f 
RIP  [<ffffffff8116a682>] mem_cgroup_update_file_mapped+0x52/0x90
 RSP <ffff880b8b457c98>
CR2: ffffc90019514410

Environment

  • Red Hat Enterprise Linux, version 6

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.