Hi VMware Experts,
As per subject, i have an issue where NFS datastore can't be mounted only to several ESXi hosts. So there are 5 clusters :
- Cluster 1 : 2 esxi hosts 6.0
- Cluster 2 : 5 esxi hosts 6.5
- Cluster 3 : 8 esxi hosts 6.5U1
- Cluster 4 : 5 esxi hosts 6.5U2
- Cluster 5 : 6 esxi hosts 6.5
Cluster 1, 2, 5, no issues, all working good
Cluster 3 : only 1 esxi is working, others are not
Cluster 4 : only 1 esxi is working, others are not
I have reviewed and make sure all ESXi networking (vmkernel adapter, vSwitch, vmnic, etc), Security Profile, Firewall are the same in all ESXi hosts.
From failing nodes i did these tests :
- nc -zv to NFS server and port 111 : success
- nc -zv to NFS server and port 2049 : success
- vmkping also success
But when NFS datastore was added, it was failed, tcpdump showed seems no packet are sent from ESXi hosts.
All ESXi hosts and NFS server are in same VLAN and same subnet, so no firewall at all. Also there is no ACL in the switch.
I have searched in the VMTN and seems this issue is similar with :
Re: Unable to add NFS datastore in ESXI 6.5
NFS mount failed: Unable to connect to NFS server.
But there is no resolution in that both thread yet.
Does anyone can give some clue on which part i should check?
Thanks alot
Try to mount the Share directly from the commandline by using esxcfg-nas and take a look into vmkernel.log. You may got a better hint from the error msg rather than in the GUI. When the vmkping works than it is most likely the EXPORTS on the Storage site which means there is an ACL still missing.
What kind of storage?
Regards,
Joerg
Hi Joerg,
Here is the log from vmkernel.log, it is very similar with this case Re: Unable to add NFS datastore in ESXI 6.5
2018-11-15T11:09:00.330Z cpu1:68326 opID=390fcf0d)NFS: 157: Command: (mount) Server: (172.16.98.101) IP: (172.16.98.101) Path: (/sd/mount/vmware/d9040a12-9d79-463c-b7dc-9af832fd0a86_data) Label: (rubrik_d9040a129d79463cb7dc9af832fd0a86) Options: (None)
2018-11-15T11:09:00.330Z cpu1:68326 opID=390fcf0d)StorageApdHandler: 977: APD Handle b02d8758-781101ab Created with lock[StorageApd-0x430ae8c2df50]
2018-11-15T11:09:30.386Z cpu1:68326 opID=390fcf0d)StorageApdHandler: 1062: Freeing APD handle 0x430ae8c2df50 [b02d8758-781101ab]
2018-11-15T11:09:30.386Z cpu1:68326 opID=390fcf0d)StorageApdHandler: 1147: APD Handle freed!
2018-11-15T11:09:30.386Z cpu1:68326 opID=390fcf0d)NFS: 168: NFS mount 172.16.98.101:/sd/mount/vmware/d9040a12-9d79-463c-b7dc-9af832fd0a86_data failed: Unable to connect to NFS server.
The storage is Rubrik, this is Rubrik feature called Live Mount, but i am sure this is not related with Rubrik itself since the other ESXi hosts are fine.
Thanks alot
