Cloudera application is highly sensitive to system swapping. What are the recommended approaches to reduce system swap activity?

Solution Unverified - Updated -

Issue

  • Even a low rate of system swapping negatively impacts the Cloudera application, which is highly sensitive to swap activity.
  • The system is just producing a small swapping (6GB of 100GB) but it still poses an issue in the application.
  • Despite a large amount of available memory, the OS appears to be actively swapping out anonymous pages.
$ cat proc/meminfo 
MemTotal:       527271072 kB <<----- 502.8 GB
MemFree:         3279508 kB  <<-----   3.1 GB
MemAvailable:   434230504 kB <<----- 414.1 GB
    ...
// A significant portion of physical memory (~78%) is occupied by page cache.
Cached:         411181368 kB <<----- 392.1 GB
    ...
Active(anon):   28043404 kB  <<-----  26.7 GB \___ Swap-backed anonymous pages: 67.6 GB
Inactive(anon): 42859028 kB  <<-----  40.9 GB /
Active(file):   26329804 kB  <<-----  25.1 GB \___ File-backed page-cache pages: 389.7 GB
Inactive(file): 382304132 kB <<----- 364.6 GB /
    ...

SwapTotal:      109051896 kB <<----- 104.0 GB \___ Only 6.3 GB (6%) is swapping
SwapFree:       102472040 kB <<-----  97.7 GB /
    ...
Slab:           33384272 kB  <<-----  31.8 GB
SReclaimable:   25642888 kB  <<-----  24.5 GB
SUnreclaim:      7741384 kB  <<-----   7.4 GB
    ...

Environment

  • Red Hat Enterprise Linux 9
  • Cloudera Application
  • Cgroup v2

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content