Can't find where 5% of memory is allocated.

Solution In Progress - Updated -

Issue

  • It was detected that 5% (19 GiB) of the compute memory is allocated to something which is not visible,could be kernel memory leak.
  • Total huepage: 300.00 GiB which is 79% of total RAM
  • Free hugepage: 228.00 GiB which is 60% of total RAM
  • Reserved hugepage: 0.0 GiB which is 0% of total RAM

Considering 300.00 GiB pre-configured for huge pages ( 79 % of total RAM):
hugepage+process+slab+cache = 300+2.57+.73+.99=304.29 ~ 81%.
I was unable to account for about 19 GiB(~5%) of memory on the Compute node.

* Total RSS used by all processes ~2.57 GiB (includes shared memory)

* Below is the top 10 memory consuming processes
    USER      PID    %CPU  %MEM  VSZ-MiB  RSS-MiB  TTY    STAT   START  TIME   COMMAND  
    root      88290  18.0  0.0   1299     144      pts/7  Sl+    22:55  0:20   /usr/bin/python /sbin/sosreport 
    42436     36620  1.6   0.0   2103     141      ?      Ssl    21:18  1:40   /usr/bin/python2 /usr/bin/nova-compute 
    42435     36822  0.6   0.0   331      121      ?      S      21:18  0:35   /usr/bin/python2 /usr/bin/neutron-openvswitch-agent --config-file 
    openvsw+  31479  1.0   0.0   724      94       ?      S<Lsl  21:17  1:05   ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer 
    42435     36324  0.0   0.0   286      85       ?      Ss     21:18  0:05   /usr/bin/python2 /usr/bin/neutron-l3-agent --config-file 
    42435     36070  0.0   0.0   282      83       ?      Ss     21:18  0:05   /usr/bin/python2 /usr/bin/neutron-sriov-nic-agent --config-file 
    42435     35938  0.0   0.0   281      81       ?      Ss     21:18  0:04   /usr/bin/python2 /usr/bin/neutron-metadata-agent --config-file 
    qemu      38948  25.8  0.0   8885     76       ?      Sl     21:19  25:12  /usr/libexec/qemu-kvm -name guest=instance-0000014e,debug-threads=on 
    42435     36803  0.0   0.0   279      75       ?      S      21:18  0:00   /usr/bin/python2 /usr/bin/neutron-metadata-agent --config-file 
    42435     36802  0.0   0.0   279      75       ?      S      21:18  0:00   /usr/bin/python2 /usr/bin/neutron-metadata-agent --config-file 

Environment

  • Red Hat OpenStack Platform 13.0

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content