How to Find the root cause for VM hung/crash
Hi All,
Recently we are facing Linux VMs going to hung state.
I don't see any abnormal message in messages.
VMware analysed and saying even nothing abnormal from there end.
Please help to set any proactive measure to capture or identify what caused the VM to go to hung state/crashed.
If kdump is the way to capture, can you please direct me what parameters I have to set up in sysctl to capture the logs to find the root cause.
Logs:
Feb 16 13:46:41 RHELserver01 vgptool[21770]: [UnixLogger:ERROR] [ERROR extension.cpp:259] Error was 2: No such file or directory
Feb 16 13:46:41 RHELserver01 vgptool[21770]: [UnixLogger:ERROR] [ERROR vtlalic.cpp:177] CSE: License file '/var/opt/quest/vgp/gpt/8463B4F7-364B-4498-A327-EFC36732AD92/Machine/V
GP/VTLA/Licensing/VAS_license_171-35680' failed installation#012 Error was License file has expired
Feb 16 20:59:34 RHELserver01 kernel: imklog 5.8.10, log source = /proc/kmsg started.
Feb 16 20:59:34 RHELserver01 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="1855" x-info="http://www.rsyslog.com"] start
Feb 16 20:59:34 RHELserver01 kernel: Initializing cgroup subsys cpuset
Feb 16 20:59:34 RHELserver01 kernel: Initializing cgroup subsys cpu
Feb 16 20:59:34 RHELserver01 kernel: Linux version 2.6.32-279.el6.x86_64 (mockbuild@x86-008.build.bos.redhat.com) (gcc version 4.4.6 20120305 (Red Hat 4.4.6-4) (GCC) ) #1 SMP Wed Jun 13 18:24:36 EDT 2012
Feb 16 20:59:34 RHELserver01 kernel: Command line: ro root=/dev/mapper/VolGroup00-LogVol00 rd_NO_LUKS LANG=en_US.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto rd_LVM_LV=VolGroup00/LogVol01 rd_LVM_LV=VolGroup00/LogVol00 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rhgb quiet
For SAR output:
Linux 2.6.32-279.el6.x86_64 (RHELserver01) 2014-02-16 x86_64 (8 CPU)
00:00:01 CPU %usr %nice %sys %iowait %steal %irq %soft %guest %idle
15:00:01 6 1.13 0.00 0.24 0.00 0.00 0.00 0.01 0.00 98.62
15:00:01 7 0.07 0.00 0.04 0.01 0.00 0.00 0.00 0.00 99.88
Average: all 2.09 0.00 0.31 0.04 0.00 0.00 0.01 0.00 97.55
Average: 0 0.86 0.00 0.19 0.11 0.00 0.00 0.01 0.00 98.83
Average: 1 4.08 0.00 0.82 0.05 0.00 0.00 0.04 0.00 95.02
