Gluster storage is getting hung after adding a large preallocated disk from RHV
Issue
- When adding a large
preallocated
disk, the gluster storage is becoming unresponsive and the vdsm monitoring thread is showing below error message.
2019-03-29 17:37:36,419+0800 ERROR (check/loop) [storage.Monitor] Error checking path /rhev/data-center/mnt/glusterSD/10.0.0.1:_data/58fa6705-ab89-4962-9fc5-e7149048c1fe/dom_md/metadata (monitor:498)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/vdsm/storage/monitor.py", line 496, in _pathChecked
delay = result.delay()
File "/usr/lib/python2.7/site-packages/vdsm/storage/check.py", line 391, in delay
raise exception.MiscFileReadException(self.path, self.rc, self.err)
MiscFileReadException: Internal file read failure: (u'/rhev/data-center/mnt/glusterSD/10.0.0.1:_data/58fa6705-ab89-4962-9fc5-e7149048c1fe/dom_md/metadata', 1, 'Read timeout')
- The entire environment is unstable after this and Gluster storage is inaccessible from the host.
Environment
- Red Hat Virtualization 4.2.
- Red Hat Gluster Storage 3.4.3.
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.