Can't find where 5% of memory is allocated.

Solution In Progress - Updated -

Issue

  • It was detected that 5% (19 GiB) of the compute memory is allocated to something which is not visible,could be kernel memory leak.
  • Total huepage: 300.00 GiB which is 79% of total RAM
  • Free hugepage: 228.00 GiB which is 60% of total RAM
  • Reserved hugepage: 0.0 GiB which is 0% of total RAM

Considering 300.00 GiB pre-configured for huge pages ( 79 % of total RAM):
hugepage+process+slab+cache = 300+2.57+.73+.99=304.29 ~ 81%.
I was unable to account for about 19 GiB(~5%) of memory on the Compute node.

* Total RSS used by all processes ~2.57 GiB (includes shared memory)

* Below is the top 10 memory consuming processes
    USER      PID    %CPU  %MEM  VSZ-MiB  RSS-MiB  TTY    STAT   START  TIME   COMMAND  
    root      88290  18.0  0.0   1299     144      pts/7  Sl+    22:55  0:20   /usr/bin/python /sbin/sosreport 
    42436     36620  1.6   0.0   2103     141      ?      Ssl    21:18  1:40   /usr/bin/python2 /usr/bin/nova-compute 
    42435     36822  0.6   0.0   331      121      ?      S      21:18  0:35   /usr/bin/python2 /usr/bin/neutron-openvswitch-agent --config-file 
    openvsw+  31479  1.0   0.0   724      94       ?      S<Lsl  21:17  1:05   ovs-vswitchd unix:/var/run/openvswitch/db.sock -vconsole:emer 
    42435     36324  0.0   0.0   286      85       ?      Ss     21:18  0:05   /usr/bin/python2 /usr/bin/neutron-l3-agent --config-file 
    42435     36070  0.0   0.0   282      83       ?      Ss     21:18  0:05   /usr/bin/python2 /usr/bin/neutron-sriov-nic-agent --config-file 
    42435     35938  0.0   0.0   281      81       ?      Ss     21:18  0:04   /usr/bin/python2 /usr/bin/neutron-metadata-agent --config-file 
    qemu      38948  25.8  0.0   8885     76       ?      Sl     21:19  25:12  /usr/libexec/qemu-kvm -name guest=instance-0000014e,debug-threads=on 
    42435     36803  0.0   0.0   279      75       ?      S      21:18  0:00   /usr/bin/python2 /usr/bin/neutron-metadata-agent --config-file 
    42435     36802  0.0   0.0   279      75       ?      S      21:18  0:00   /usr/bin/python2 /usr/bin/neutron-metadata-agent --config-file 

Environment

  • Red Hat OpenStack Platform 13.0

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In