Cloudera application is highly sensitive to system swapping. What are the recommended approaches to reduce system swap activity?
Issue
- Even a low rate of system swapping negatively impacts the Cloudera application, which is highly sensitive to swap activity.
- The system is just producing a small swapping (6GB of 100GB) but it still poses an issue in the application.
- Despite a large amount of available memory, the OS appears to be actively swapping out anonymous pages.
$ cat proc/meminfo
MemTotal: 527271072 kB <<----- 502.8 GB
MemFree: 3279508 kB <<----- 3.1 GB
MemAvailable: 434230504 kB <<----- 414.1 GB
...
// A significant portion of physical memory (~78%) is occupied by page cache.
Cached: 411181368 kB <<----- 392.1 GB
...
Active(anon): 28043404 kB <<----- 26.7 GB \___ Swap-backed anonymous pages: 67.6 GB
Inactive(anon): 42859028 kB <<----- 40.9 GB /
Active(file): 26329804 kB <<----- 25.1 GB \___ File-backed page-cache pages: 389.7 GB
Inactive(file): 382304132 kB <<----- 364.6 GB /
...
SwapTotal: 109051896 kB <<----- 104.0 GB \___ Only 6.3 GB (6%) is swapping
SwapFree: 102472040 kB <<----- 97.7 GB /
...
Slab: 33384272 kB <<----- 31.8 GB
SReclaimable: 25642888 kB <<----- 24.5 GB
SUnreclaim: 7741384 kB <<----- 7.4 GB
...
Environment
- Red Hat Enterprise Linux 9
- Cloudera Application
- Cgroup v2
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.