System ran out of memory due to an unreclaimable kmalloc-4k slab consumption by the vxio module

Solution Verified - Updated -

Issue

  • The system ran out of memory due to an unreclaimable kmalloc-4k slab usage.
[127581.832206] Unreclaimable slab info:
[127581.832207] Name                      Used        Total
...
[127581.833215] kmalloc-4k          11251696KB   11251696KB
...
[127581.834852] Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled
[127581.834924] CPU: 3 PID: 2681738 Comm: vxnetd Kdump: loaded Tainted: POE ---------- 4.18.0-553.30.1.el8_10.x86_64 #1
[127581.834972] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
[127581.835013] Call Trace:
[127581.835028]  dump_stack+0x41/0x60
[127581.835048]  panic+0xe7/0x2ac
[127581.835066]  out_of_memory.cold.36+0x2f/0x7e
[127581.835089]  __alloc_pages_slowpath+0xbf0/0xcd0
[127581.835113]  __alloc_pages_nodemask+0x2e2/0x330
[127581.835135]  __vmalloc_node_range+0x13f/0x250
[127581.835157]  __vmalloc_node+0x36/0x60
[127581.835176]  ? vol_alloc+0x165/0x270 [vxio]
[127581.835351]  vol_alloc+0x165/0x270 [vxio]
[127581.835499]  vol_zalloc+0xe/0x30 [vxio]
[127581.835641]  kmsg_sys_rcv+0xc3/0x1c0 [vxio]
[127581.835722]  ? free_debug_processing+0x3e8/0x4c0
[127581.835746]  ? nmcom_deliver+0x110/0x330 [vxio]
[127581.835904]  ? kfree+0x22e/0x250
[127581.835921]  nmcom_get_next_mblk+0x8e/0xf0 [vxio]
[127581.836055]  nmcom_get_hdr_msg+0x108/0x200 [vxio]
[127581.836221]  nmcom_get_next_msg+0x7d/0x100 [vxio]
[127581.836357]  nmcom_wait_msg_tcp+0x97/0x160 [vxio]
[127581.836494]  nmcom_server_proc_tcp+0x58/0xe0 [vxio]
[127581.836630]  nmcom_server_main_tcp+0x4ce/0x11d0 [vxio]
[127581.836765]  ? arch_stack_walk+0x8f/0x100
[127581.836786]  ? ret_from_fork+0x1f/0x40
[127581.836808]  ? update_load_avg+0x7e/0x710
[127581.836830]  ? __schedule+0x2d9/0x870
[127581.836848]  ? nmcom_server_proc_tcp+0xe0/0xe0 [vxio]
[127581.837375]  kthread+0x134/0x150
[127581.837625]  ? set_kthread_struct+0x50/0x50
[127581.837826]  ret_from_fork+0x1f/0x40

Environment

  • Red Hat Enterprise Linux 8
  • Veritas vxio kernel module (version 8.0.2.1500)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content