Gluster storage is getting hung after adding a large preallocated disk from RHV

Solution Verified - Updated -

Issue

  • When adding a large preallocated disk, the gluster storage is becoming unresponsive and the vdsm monitoring thread is showing below error message.
2019-03-29 17:37:36,419+0800 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/glusterSD/10.0.0.1:_data/58fa6705-ab89-4962-9fc5-e7149048c1fe/dom_md/metadata (monitor:498)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 496, in _pathChecked
    delay = result.delay()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/check.py", line 391, in delay
    raise exception.MiscFileReadException(self.path, self.rc, self.err)
MiscFileReadException: Internal file read failure: (u'/rhev/data-center/mnt/glusterSD/10.0.0.1:_data/58fa6705-ab89-4962-9fc5-e7149048c1fe/dom_md/metadata', 1, 'Read timeout')
  • The entire environment is unstable after this and Gluster storage is inaccessible from the host.

Environment

  • Red Hat Virtualization 4.2.
  • Red Hat Gluster Storage 3.4.3.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In