Very high memory utilisation by ovn process threads in RHOSP13.

Solution Verified - Updated -

Issue

  • We performed ROSP13 Z stream minor upgrade on stage overcloud after that we are observing sudden surge in memory by OVN on compute nodes.
  • During the spike, we see the consumption by networking-ovn thread constantly keeps increasing couple with ovs-vswitchd process constantly segaulting.
   PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 39242 root      20   0   81532  32380   2924 R  99.3  0.0   1410:14 ovn-controller
 39253 42435     20   0   38.2g  38.0g   7200 S  22.8  7.6  75:10.56 networking-ovn-
 44227 42435     20   0   37.3g  37.0g   3188 S  21.8  7.4  60:32.52 networking-ovn-
 44222 42435     20   0   37.3g  37.1g   3192 S  21.5  7.4  58:39.25 networking-ovn-
 44220 42435     20   0   37.2g  37.0g   3192 S  20.8  7.4  62:15.17 networking-ovn-
 44208 42435     20   0   37.3g  37.1g   3192 S  20.5  7.4  55:32.46 networking-ovn-
 44218 42435     20   0   37.3g  37.1g   3188 S  19.8  7.4  57:45.08 networking-ovn-
 44223 42435     20   0   37.3g  37.1g   3192 S  19.5  7.4  56:15.26 networking-ovn-
 44214 42435     20   0   37.2g  37.0g   3188 S  19.1  7.4  58:24.53 networking-ovn-
 44202 42435     20   0   37.3g  37.1g   3188 S  18.5  7.4  56:50.21 networking-ovn-
 44212 42435     20   0   37.2g  37.0g   3192 S  18.5  7.4  55:16.42 networking-ovn-
 44229 42435     20   0   37.2g  37.0g   1828 S  18.5  7.4  56:27.28 networking-ovn-
 44207 42435     20   0   37.3g  37.1g   3188 S  18.2  7.4  57:10.12 networking-ovn-
 44210 42435     20   0   37.3g  37.1g   3188 S  18.2  7.4  56:47.39 networking-ovn-
  • Very high memory utilisation by ovn processes in RHOSP13.

Environment

  • Red Hat OpenStack Platform (RHOSP) 13.0.
  • Red Hat OpenStack Platform (RHOSP) 13.0 latest z release.
  • OVN controller service.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content