RHEV - NFS Storage domain issues

Latest response

I'm trying to setup a new datacenter with an NFS storage domain however when I add the storage domain I get this error in the RHEV-M interface: "172.22.133.80:/vol/Linux_NFS_Vol01 returned by VDSM was Following Permission settings aon the specified parth do not allow access to storage."

 

I also noticed this in the VDSM manager it looks like it is able to mount the NFS export but it can't mount it in the location specified in the log.  Permissions

 

 

Thread-435::INFO::2012-04-09 15:51:59,875::storage_connection::53::Storage.ServerConnection::(__validateConnectionParams) conList=[{'connection': '172.22.133.80:/vol/Linux_NFS_Vol01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}]
Thread-435::DEBUG::2012-04-09 15:51:59,876::fileUtils::83::Storage.Misc.excCmd::(mount) '/usr/bin/sudo -n /bin/mount -o soft,timeo=600,retrans=6,nosharecache,vers=3 -t nfs 172.22.133.80:/vol/Linux_NFS_Vol01 /tmp/tmpTHf6jV' (cwd None)
Thread-435::DEBUG::2012-04-09 15:51:59,897::fileUtils::83::Storage.Misc.excCmd::(mount) SUCCESS: <err> = ''; <rc> = 0
Thread-435::DEBUG::2012-04-09 15:51:59,899::fileUtils::112::Storage.Misc.excCmd::(umount) '/usr/bin/sudo -n /bin/umount -t nfs -f /tmp/tmpTHf6jV' (cwd None)
Thread-435::DEBUG::2012-04-09 15:51:59,932::fileUtils::112::Storage.Misc.excCmd::(umount) SUCCESS: <err> = ''; <rc> = 0
Thread-435::DEBUG::2012-04-09 15:51:59,933::task::495::TaskManager.Task::(_debug) Task 1ff49c32-8d1d-40f7-9fb9-d61da86b1eb7: finished: {'statuslist': [{'status': 469, 'id': '00000000-0000-0000-0000-000000000000'}]}
Thread-435::DEBUG::2012-04-09 15:51:59,933::task::495::TaskManager.Task::(_debug) Task 1ff49c32-8d1d-40f7-9fb9-d61da86b1eb7: moving from state preparing -> state finished
Thread-435::DEBUG::2012-04-09 15:51:59,934::resourceManager::786::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-435::DEBUG::2012-04-09 15:51:59,934::resourceManager::821::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-435::DEBUG::2012-04-09 15:51:59,934::task::495::TaskManager.Task::(_debug) Task 1ff49c32-8d1d-40f7-9fb9-d61da86b1eb7: ref 0 aborting False
Thread-435::INFO::2012-04-09 15:51:59,934::dispatcher::100::Storage.Dispatcher.Protect::(run) Run and protect: validateStorageServerConnection, Return response: {'status': {'message': 'OK', 'code': 0}, 'statuslist': [{'status': 469, 'id': '00000000-0000-0000-0000-000000000000'}]}
Thread-436::DEBUG::2012-04-09 15:52:00,039::clientIF::239::Storage.Dispatcher.Protect::(wrapper) [172.22.128.90]
Thread-436::INFO::2012-04-09 15:52:00,039::dispatcher::94::Storage.Dispatcher.Protect::(run) Run and protect: disconnectStorageServer, args: (domType=1, spUUID=00000000-0000-0000-0000-000000000000, conList=[{'connection': '172.22.133.80:/vol/Linux_NFS_Vol01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}])
Thread-436::DEBUG::2012-04-09 15:52:00,040::task::495::TaskManager.Task::(_debug) Task 5215cc74-8fe4-4725-bd5f-81aee4feb6d8: moving from state init -> state preparing
Thread-436::INFO::2012-04-09 15:52:00,040::storage_connection::111::Storage.ServerConnection::(disconnect) Request to disconnect NFS storage server
Thread-436::INFO::2012-04-09 15:52:00,040::storage_connection::53::Storage.ServerConnection::(__validateConnectionParams) conList=[{'connection': '172.22.133.80:/vol/Linux_NFS_Vol01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}]
Thread-436::WARNING::2012-04-09 15:52:00,041::storage_connection::344::Storage.ServerConnection::(__disconnectFileServer) Cannot remove mountpoint after umount()
Traceback (most recent call last):
  File "/usr/share/vdsm/storage/storage_connection.py", line 339, in __disconnectFileServer
    getProcPool().os.rmdir(mntPath)
  File "/usr/share/vdsm/storage/processPool.py", line 33, in wrapper
    return self.runExternally(func, *args, **kwds)
  File "/usr/share/vdsm/storage/processPool.py", line 44, in runExternally
    return self._procPool.runExternally(*args, **kwargs)
  File "/usr/share/vdsm/storage/processPool.py", line 127, in runExternally
    raise err
OSError: [Errno 13] Permission denied: '/rhev/data-center/mnt/172.22.133.80:_vol_Linux__NFS__Vol01'
Thread-436::DEBUG::2012-04-09 15:52:00,042::misc::1010::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
Thread-436::DEBUG::2012-04-09 15:52:00,042::misc::1012::SamplingMethod::(__call__) Got in to sampling method
Thread-436::DEBUG::2012-04-09 15:52:00,042::misc::1010::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
Thread-436::DEBUG::2012-04-09 15:52:00,042::misc::1012::SamplingMethod::(__call__) Got in to sampling method
Thread-436::DEBUG::2012-04-09 15:52:00,043::iscsi::699::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
Thread-436::DEBUG::2012-04-09 15:52:00,056::iscsi::699::Storage.Misc.excCmd::(rescan) FAILED: <err> = 'iscsiadm: No session found.\n'; <rc> = 21
Thread-436::DEBUG::2012-04-09 15:52:00,056::misc::1020::SamplingMethod::(__call__) Returning last result
Thread-436::DEBUG::2012-04-09 15:52:00,381::multipath::61::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None)
Thread-436::DEBUG::2012-04-09 15:52:00,420::multipath::61::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
Thread-436::DEBUG::2012-04-09 15:52:00,421::lvm::547::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-436::DEBUG::2012-04-09 15:52:00,421::lvm::549::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-436::DEBUG::2012-04-09 15:52:00,422::lvm::559::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
Thread-436::DEBUG::2012-04-09 15:52:00,422::lvm::561::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
Thread-436::DEBUG::2012-04-09 15:52:00,422::lvm::580::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
Thread-436::DEBUG::2012-04-09 15:52:00,423::lvm::582::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
Thread-436::DEBUG::2012-04-09 15:52:00,423::misc::1020::SamplingMethod::(__call__) Returning last result
Thread-436::DEBUG::2012-04-09 15:52:00,423::task::495::TaskManager.Task::(_debug) Task 5215cc74-8fe4-4725-bd5f-81aee4feb6d8: finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}
Thread-436::DEBUG::2012-04-09 15:52:00,423::task::495::TaskManager.Task::(_debug) Task 5215cc74-8fe4-4725-bd5f-81aee4feb6d8: moving from state preparing -> state finished
Thread-436::DEBUG::2012-04-09 15:52:00,424::resourceManager::786::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
Thread-436::DEBUG::2012-04-09 15:52:00,424::resourceManager::821::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
Thread-436::DEBUG::2012-04-09 15:52:00,424::task::495::TaskManager.Task::(_debug) Task 5215cc74-8fe4-4725-bd5f-81aee4feb6d8: ref 0 aborting False

 

 

In this senerio the hypervisior is a basic server install with RHEL 6.2.

 

Responses

Do you have the permissions for the NFS share set?

chown -R 36:36 /path/to/sharedNFSdir - This is mentioned in all the guides

I figured out the NFS problem.  It was set to 36:36 but a problem on my netapp.

 

 

Right now I'm able to get my storage up and connected but it seems to be randomly disconnecting from the SPM.  

 

 

The netapp logs look clean.

What did you change on you netapp, having the same issues now, also with netapp, but configured along a netapp for KVM guide. Any idea, really annyong, blocked for a while already...