Gluster storage is getting hung after adding a large preallocated disk from RHV

Solution Verified - Updated -

Issue

  • When adding a large preallocated disk, the gluster storage is becoming unresponsive and the vdsm monitoring thread is showing below error message.
2019-03-29 17:37:36,419+0800 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/glusterSD/10.0.0.1:_data/58fa6705-ab89-4962-9fc5-e7149048c1fe/dom_md/metadata (monitor:498)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 496, in _pathChecked
    delay = result.delay()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/check.py", line 391, in delay
    raise exception.MiscFileReadException(self.path, self.rc, self.err)
MiscFileReadException: Internal file read failure: (u'/rhev/data-center/mnt/glusterSD/10.0.0.1:_data/58fa6705-ab89-4962-9fc5-e7149048c1fe/dom_md/metadata', 1, 'Read timeout')
  • The entire environment is unstable after this and Gluster storage is inaccessible from the host.

Environment

  • Red Hat Virtualization 4.2.
  • Red Hat Gluster Storage 3.4.3.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content