Frequent kernel panics in mem_cgroup_update_file_mapped
Issue
- Experiencing kernel WARNINGs followed by full kernel panics with the following signature:
------------[ cut here ]------------
WARNING: at kernel/cgroup.c:4052 __css_put+0x70/0x80() (Not tainted)
Hardware name: PowerEdge C2100
Modules linked in: fuse bonding 8021q garp stp llc autofs4 sunrpc ipv6 dm_mirror dm_region_hash dm_log sg dcdbas serio_raw i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support igb dca i7core_edac edac_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif megaraid_sas pata_acpi ata_generic ata_piix dm_mod [last unloaded: microcode]
Pid: 7883, comm: postgres Not tainted 2.6.32-279.22.1.el6.x86_64 #1
Call Trace:
[<ffffffff8106a2a7>] ? warn_slowpath_common+0x87/0xc0
[<ffffffff8106a2fa>] ? warn_slowpath_null+0x1a/0x20
[<ffffffff810bf4b0>] ? __css_put+0x70/0x80
[<ffffffff810bf4ec>] ? cgroup_release_and_wakeup_rmdir+0x2c/0x40
[<ffffffff8116b7e1>] ? __mem_cgroup_commit_charge_swapin+0x181/0x230
[<ffffffff8116ba09>] ? mem_cgroup_cache_charge+0x89/0x130
[<ffffffff8111045a>] ? add_to_page_cache_locked+0x4a/0x140
[<ffffffff811301be>] ? shmem_getpage+0x32e/0x9f0
[<ffffffff811308cd>] ? shmem_fault+0x4d/0x70
[<ffffffff811fea7e>] ? shm_fault+0x1e/0x20
[<ffffffff8113a994>] ? __do_fault+0x54/0x510
[<ffffffff8113af47>] ? handle_pte_fault+0xf7/0xb50
[<ffffffffa008acc2>] ? ext4_get_blocks+0x192/0x2a0 [ext4]
[<ffffffff8113bbda>] ? handle_mm_fault+0x23a/0x310
[<ffffffff810432d9>] ? __do_page_fault+0x139/0x480
[<ffffffff811a8b17>] ? __set_page_dirty+0x87/0xf0
[<ffffffff81052223>] ? __wake_up+0x53/0x70
[<ffffffff814efa4e>] ? do_page_fault+0x3e/0xa0
[<ffffffff8110f1ac>] ? iov_iter_fault_in_readable+0x4c/0x60
[<ffffffff811109a2>] ? generic_file_buffered_write+0xf2/0x2e0
[<ffffffff81112370>] ? __generic_file_aio_write+0x250/0x480
[<ffffffff8111260f>] ? generic_file_aio_write+0x6f/0xe0
[<ffffffffa00840b1>] ? ext4_file_write+0x61/0x1e0 [ext4]
[<ffffffff811764ca>] ? do_sync_write+0xfa/0x140
[<ffffffff81090be0>] ? autoremove_wake_function+0x0/0x40
[<ffffffff8118ef4a>] ? dput+0x9a/0x150
[<ffffffff8120cd06>] ? security_file_permission+0x16/0x20
[<ffffffff811767c8>] ? vfs_write+0xb8/0x1a0
[<ffffffff811770c1>] ? sys_write+0x51/0x90
[<ffffffff810d3c95>] ? __audit_syscall_exit+0x265/0x290
[<ffffffff8100b072>] ? system_call_fastpath+0x16/0x1b
---[ end trace 137bc36ff7a609a4 ]---
BUG: unable to handle kernel paging request at ffffc90019514410
IP: [<ffffffff8116a682>] mem_cgroup_update_file_mapped+0x52/0x90
PGD c3feb8067 PUD c3feb9067 PMD 8773e3067 PTE 0
Oops: 0002 [#1] SMP
last sysfs file: /sys/devices/system/cpu/cpu23/cache/index2/shared_cpu_map
CPU 12
Modules linked in: fuse bonding 8021q garp stp llc autofs4 sunrpc ipv6 dm_mirror dm_region_hash dm_log sg dcdbas serio_raw i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support igb dca i7core_edac edac_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif megaraid_sas pata_acpi ata_generic ata_piix dm_mod [last unloaded: microcode]
Pid: 7883, comm: postgres Tainted: G W --------------- 2.6.32-279.22.1.el6.x86_64 #1 Dell PowerEdge C2100 /0P19C9
RIP: 0010:[<ffffffff8116a682>] [<ffffffff8116a682>] mem_cgroup_update_file_mapped+0x52/0x90
RSP: 0018:ffff880b8b457c98 EFLAGS: 00010206
RAX: ffff880c2c37f0c0 RBX: ffffea00237de550 RCX: 0000000000000300
RDX: ffffc90019513000 RSI: ffffffffffffffff RDI: 000000001447f0c0
RBP: ffff880b8b457ca8 R08: 0000000000000064 R09: 0000000000000000
R10: ffff880028407d00 R11: 0000000000000000 R12: 00000000ffffffff
R13: ffff880bada62850 R14: 00000000002bbdcd R15: ffff8808770311a8
FS: 0000000000000000(0000) GS:ffff880053780000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffc90019514410 CR3: 0000000001a85000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process postgres (pid: 7883, threadinfo ffff880b8b456000, task ffff880c15cc2080)
Stack:
ffffea00237de550 00007f88a1600000 ffff880b8b457cc8 ffffffff81143faa
<d> 0000000000400000 00007f88a1435000 ffff880b8b457e08 ffffffff81138ed6
<d> 0000000000000000 0000000000000000 ffff880b8b457d18 ffffffff00000025
Call Trace:
[<ffffffff81143faa>] page_remove_rmap+0x7a/0xa0
[<ffffffff81138ed6>] unmap_vmas+0x706/0xc30
[<ffffffff8113e9d7>] exit_mmap+0x87/0x170
[<ffffffff810674dc>] mmput+0x6c/0x120
[<ffffffff8106eceb>] exit_mm+0x12b/0x180
[<ffffffff8106f09f>] do_exit+0x15f/0x870
[<ffffffff8106f808>] do_group_exit+0x58/0xd0
[<ffffffff8106f897>] sys_exit_group+0x17/0x20
[<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
Code: 48 8b 50 08 48 85 d2 74 05 f6 00 04 75 0b f0 80 20 fe 5b 41 5c c9 c3 66 90 65 8b 0c 25 b8 e0 00 00 48 63 c9 49 63 f4 48 c1 e1 06 <48> 01 b4 0a 10 11 00 00 45 85 e4 7e 09 f0 80 08 10 eb d0 0f 1f
RIP [<ffffffff8116a682>] mem_cgroup_update_file_mapped+0x52/0x90
RSP <ffff880b8b457c98>
CR2: ffffc90019514410
Environment
- Red Hat Enterprise Linux, version 6
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.