VMware guest system hang due to frozen filesystems, vmtoolsd not blocked but running in a sys_times system call

Solution In Progress - Updated -

Issue

  • VMware VM / guest system hang with frozen filesystems, vmtoolsd running and has the following backtrace
PID: 1090   TASK: ffff880237d3d500  CPU: 0   COMMAND: "vmtoolsd"
 #0 [ffff88023aced978] schedule at ffffffff81529990
 #1 [ffff88023aced980] thread_return at ffffffff815299de
 #2 [ffff88023aceda50] schedule_hrtimeout_range at ffffffff8152bf30
 #3 [ffff88023acedb10] do_sys_poll at ffffffff811a5fe0
 #4 [ffff88023acedf40] sys_times at ffffffff81095339
 #5 [ffff88023acedf80] system_call_fastpath at ffffffff8100b072
  • One another thing that I came across is "vmware-tools-plugins-vmbackup" rpm. We have started installing "vmware-tools-esx-nox" and as a dependency this "vmware-tools-plugins-vmbackup" comes in. I can't figure out why we have started using it and i am working on it.
    As you see we have lot of systems affected and I guess after we started installing this rpm we might be seeing this problem, though i could be completely wrong, i wanted to put this point across.
  • To summarise the problem, with first kdump uploaded, we were informed that vmtoolsd causing deadlock and then we talked VMware and they asked us to update VMtools, after the upgrade, all systems that were upgraded got hung. And as a test, i removed vmbackup rpm few systems and those systems seem fine.

Environment

  • Red Hat Enterprise Linux 6
    • seen on kernel 2.6.32-504.8.1.el6
  • Red Hat Enterprise Linux 5
  • seen with vmware-tools-plugins-vmbackup RPM

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content