Out of memory (OOM) killer in memory cgroup

Solution Unverified - Updated -

Issue

  • System kills process if memory cgroup on system gets out of memory and reaches cgroup memory limit
Nov  1 16:11:42 lab kernel: s1-agent invoked oom-killer: gfp_mask=0xd0, order=0, oom_score_adj=0
Nov  1 16:11:42 lab kernel: s1-agent cpuset=/ mems_allowed=0-1
Nov  1 16:11:42 lab kernel: CPU: 45 PID: 13331 Comm: s1-agent Tainted: G        W      ------------   3.10.0-957.21.3.el7.x86_64 #1
Nov  1 16:11:42 lab kernel: Hardware name: HP ProLiant XL450 Gen9 Server/ProLiant XL450 Gen9 Server, BIOS U21 01/22/2018
Nov  1 16:11:42 lab kernel: Call Trace:
Nov  1 16:11:42 lab kernel: [<ffffffffa4763107>] dump_stack+0x19/0x1b
Nov  1 16:11:42 lab kernel: [<ffffffffa475db2a>] dump_header+0x90/0x229
Nov  1 16:11:42 lab kernel: [<ffffffffa41ba386>] ? find_lock_task_mm+0x56/0xc0
Nov  1 16:11:42 lab kernel: [<ffffffffa42317a8>] ? try_get_mem_cgroup_from_mm+0x28/0x60
Nov  1 16:11:42 lab kernel: [<ffffffffa41ba834>] oom_kill_process+0x254/0x3d0
Nov  1 16:11:42 lab kernel: [<ffffffffa4235586>] mem_cgroup_oom_synchronize+0x546/0x570
Nov  1 16:11:42 lab kernel: [<ffffffffa4234a00>] ? mem_cgroup_charge_common+0xc0/0xc0
Nov  1 16:11:42 lab kernel: [<ffffffffa41bb0c4>] pagefault_out_of_memory+0x14/0x90
Nov  1 16:11:42 lab kernel: [<ffffffffa475c032>] mm_fault_error+0x6a/0x157
Nov  1 16:11:42 lab kernel: [<ffffffffa47707c8>] __do_page_fault+0x3c8/0x4f0
Nov  1 16:11:42 lab kernel: [<ffffffffa4770925>] do_page_fault+0x35/0x90
Nov  1 16:11:42 lab kernel: [<ffffffffa476c768>] page_fault+0x28/0x30
Nov  1 16:11:42 lab kernel: Task in /agent killed as a result of limit of /agent
Nov  1 16:11:42 lab kernel: memory: usage 1048576kB, limit 1048576kB, failcnt 1559756
Nov  1 16:11:42 lab kernel: memory+swap: usage 1048752kB, limit 9007199254740988kB, failcnt 0
Nov  1 16:11:42 lab kernel: kmem: usage 0kB, limit 9007199254740988kB, failcnt 0
Nov  1 16:11:42 lab kernel: Memory cgroup stats for /agent: cache:136KB rss:1048440KB rss_huge:0KB mapped_file:0KB swap:176KB inactive_anon:528216KB active_anon:520188KB inactive_file:44KB active_file:24KB unevictable:0KB
Nov  1 16:11:42 lab kernel: [ pid ]   uid  tgid total_vm      rss nr_ptes swapents oom_score_adj name
Nov  1 16:11:42 lab kernel: [13293]   992 13293  3411343   264627     985       61             0 s1-agent
Nov  1 16:11:42 lab kernel: Memory cgroup out of memory: Kill process 22811 (s1-agent) score 112 or sacrifice child
Nov  1 16:11:42 lab kernel: Killed process 13293 (s1-agent) total-vm:13645372kB, anon-rss:1052332kB, file-rss:6176kB, shmem-rss:0kB

Environment

  • Red Hat Enterprise Linux
  • System kills process if memory cgroup on system gets out of memory and reaches cgroup memory limit.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content