The VM NUMA CPU assignments are sampled too often causing the load average on hypervisor to increase over time.
Issue
-
The load average on the hypervisor grows over the time.
-
Hypervisor can also transition to Non-Operational state.
-
VM running on the hypervisor change to pause state.
-
Restarting the vdsmd daemon process decreases the load average but starts to increase over time.
00:21:43 up 68 days, 4:42, 1 user, load average: 30.11, 25.16, 22.70
#systemctl stop vdsmd
00:22:33 up 68 days, 4:42, 2 users, load average: 29.40, 25.83, 23.06
00:22:53 up 68 days, 4:43, 2 users, load average: 26.20, 25.33, 22.95
00:23:01 up 68 days, 4:43, 2 users, load average: 24.32, 24.95, 22.86
00:23:36 up 68 days, 4:43, 2 users, load average: 16.58, 22.95, 22.26
00:24:11 up 68 days, 4:44, 2 users, load average: 12.09, 21.13, 21.68
00:24:24 up 68 days, 4:44, 2 users, load average: 11.06, 20.61, 21.50
00:24:38 up 68 days, 4:44, 2 users, load average: 9.49, 19.80, 21.22
00:24:53 up 68 days, 4:45, 2 users, load average: 7.98, 18.96, 20.93
#systemctl start vdsmd
00:26:00 up 68 days, 4:46, 2 users, load average: 5.69, 16.23, 19.86
00:25:15 up 68 days, 4:45, 2 users, load average: 8.13, 18.29, 20.67
00:25:44 up 68 days, 4:46, 2 users, load average: 6.35, 16.89, 20.13
00:26:12 up 68 days, 4:46, 2 users, load average: 5.87, 15.76, 19.65
00:26:27 up 68 days, 4:46, 2 users, load average: 5.60, 15.22, 19.41
00:26:53 up 68 days, 4:47, 2 users, load average: 5.55, 14.44, 19.04
00:27:26 up 68 days, 4:47, 2 users, load average: 6.61, 13.83, 18.69
00:27:58 up 68 days, 4:48, 2 users, load average: 7.31, 13.17, 18.29
00:28:43 up 68 days, 4:49, 2 users, load average: 15.40, 14.34, 18.43
00:29:53 up 68 days, 4:50, 2 users, load average: 20.66, 16.20, 18.78
00:30:55 up 68 days, 4:51, 2 users, load average: 25.88, 18.48, 19.40
00:31:40 up 68 days, 4:51, 2 users, load average: 28.35, 20.13, 19.92
Environment
- Red Hat Enterprise Virtualization (RHEV-M) 3.6.9
- VDSM vdsm-4.17.35-1.el7ev.noarch
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
