Very high memory utilisation by ovn process threads in RHOSP13.

Solution Verified - Updated -

Issue

  • We performed ROSP13 Z stream minor upgrade on stage overcloud after that we are observing sudden surge in memory by OVN on compute nodes.
  • During the spike, we see the consumption by networking-ovn thread constantly keeps increasing couple with ovs-vswitchd process constantly segaulting.
   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 39242 root      20   0   81532  32380   2924 R  99.3  0.0   1410:14 ovn-controller
 39253 42435     20   0   38.2g  38.0g   7200 S  22.8  7.6  75:10.56 networking-ovn-
 44227 42435     20   0   37.3g  37.0g   3188 S  21.8  7.4  60:32.52 networking-ovn-
 44222 42435     20   0   37.3g  37.1g   3192 S  21.5  7.4  58:39.25 networking-ovn-
 44220 42435     20   0   37.2g  37.0g   3192 S  20.8  7.4  62:15.17 networking-ovn-
 44208 42435     20   0   37.3g  37.1g   3192 S  20.5  7.4  55:32.46 networking-ovn-
 44218 42435     20   0   37.3g  37.1g   3188 S  19.8  7.4  57:45.08 networking-ovn-
 44223 42435     20   0   37.3g  37.1g   3192 S  19.5  7.4  56:15.26 networking-ovn-
 44214 42435     20   0   37.2g  37.0g   3188 S  19.1  7.4  58:24.53 networking-ovn-
 44202 42435     20   0   37.3g  37.1g   3188 S  18.5  7.4  56:50.21 networking-ovn-
 44212 42435     20   0   37.2g  37.0g   3192 S  18.5  7.4  55:16.42 networking-ovn-
 44229 42435     20   0   37.2g  37.0g   1828 S  18.5  7.4  56:27.28 networking-ovn-
 44207 42435     20   0   37.3g  37.1g   3188 S  18.2  7.4  57:10.12 networking-ovn-
 44210 42435     20   0   37.3g  37.1g   3188 S  18.2  7.4  56:47.39 networking-ovn-
  • Very high memory utilisation by ovn processes in RHOSP13.

Environment

  • Red Hat OpenStack Platform (RHOSP) 13.0.
  • Red Hat OpenStack Platform (RHOSP) 13.0 latest z release.
  • OVN controller service.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In