VMware Cloud Community
paulvz
Contributor
Contributor

Hi there - very new to vmware - but lun - vmx datastore gone

the one datastore is full and the whole vm hanged. The technician and rebooted the host and then the storage cam back as could not connect, he then removed from inventory, stopped guest and rebooted again. now everything is missing.

 

last log files

 


2021-07-21T19:56:31.069Z [37144B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] interactive guest operations are not ready

2021-07-21T19:56:31.069Z [37144B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T19:56:31.071Z [36D88B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] interactive guest operations are ready

2021-07-21T19:56:31.071Z [36D88B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:07:19.546Z [37207B90 verbose 'Default'] Datastore Accessibility cannot be inferred from relative filepath: Iretire-RemotePastel-000001.vmdk

2021-07-21T20:07:19.554Z [37207B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Time to gather config: 15 (msecs)

2021-07-21T20:07:19.579Z [37207B90 verbose 'Default'] Datastore Accessibility cannot be inferred from relative filepath: Iretire-RemotePastel-000001.vmdk

2021-07-21T20:07:19.587Z [37207B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Time to gather config: 15 (msecs)

2021-07-21T20:07:19.599Z [37207B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:08:13.598Z [36981B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:10:01.667Z [37103B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:11:15.708Z [36D88B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:16:11.858Z [370C2B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:17:25.898Z [36CFEB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:18:39.937Z [372CAB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:19:53.964Z [36D88B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:21:08.004Z [37583B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:22:22.066Z [37144B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:28:32.310Z [36D45B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:29:46.384Z [37103B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:31:00.418Z [FFFD7A90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:32:14.449Z [36CBDB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:33:28.471Z [36CFEB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:34:42.514Z [FFFD7A90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:35:56.546Z [37248B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:37:10.579Z [37248B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:38:24.620Z [37248B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:39:38.656Z [370C2B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:40:52.691Z [36DC9B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:42:45.780Z [36CFEB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] interactive guest operations are not ready

2021-07-21T20:46:21.938Z [36740B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:48:37.118Z [37248B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:49:32.153Z [36CFEB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] interactive guest operations are ready

2021-07-21T20:49:32.153Z [36CFEB90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:53:08.329Z [36DC9B90 verbose 'Default'] Datastore Accessibility cannot be inferred from relative filepath: Iretire-RemotePastel-000001.vmdk

2021-07-21T20:53:08.338Z [36DC9B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Time to gather config: 16 (msecs)

2021-07-21T20:53:08.362Z [36DC9B90 verbose 'Default'] Datastore Accessibility cannot be inferred from relative filepath: Iretire-RemotePastel-000001.vmdk

2021-07-21T20:53:08.370Z [36DC9B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Time to gather config: 14 (msecs)

2021-07-21T20:53:08.383Z [36DC9B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 1

2021-07-21T20:56:44.460Z [371C6B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T20:59:26.569Z [37185B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] Running status of tools changed to: 0

2021-07-21T21:02:13.678Z [37207B90 verbose 'vm:/vmfs/volumes/53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/Iretire-RemotePastel.vmx'] interactive guest operations are not ready

Reply
0 Kudos
12 Replies
e_espinel
Virtuoso
Virtuoso

Hello.
More information is required:
Type, model of the server
Model type of the external storage (Firmware level)
Type of connection (SAS, ISCSI, FC, SCSI) between Server and Storage
Version and build of VMware vSphere installed
Screenshot of what you currently see in Storages, devices

You must log into a SSH session (Putty) and execute the following commands and attach your results to this post
# esxcli storage filesystem list

# esxcli storage core adapter list

 

 

Enrique Espinel
Senior Technical Support on IBM, Lenovo, Veeam Backup and VMware vSphere.
VSP-SV, VTSP-SV, VTSP-HCI, VTSP
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
Reply
0 Kudos
paulvz
Contributor
Contributor

here you go.

esxcli storage filesystem list

------------------------------------------------- ----------- ----------------------------------- ------- ------ ------------ -----------
/vmfs/volumes/530b0dc0-04aa818e-cc22-001e0b74044c datastore1 530b0dc0-04aa818e-cc22-001e0b74044c true VMFS-5 141465485312 80317775872
/vmfs/volumes/530b15c1-419f0a24-c186-001e0b74044c Test VM 530b15c1-419f0a24-c186-001e0b74044c true VMFS-5 733634101248 2131755008
/vmfs/volumes/530b0dc1-690860d9-b8e1-001e0b74044c 530b0dc1-690860d9-b8e1-001e0b74044c true vfat 4293591040 4262985728
/vmfs/volumes/9e1ab57a-0af0c710-0636-13a656d621fc 9e1ab57a-0af0c710-0636-13a656d621fc true vfat 261853184 128204800
/vmfs/volumes/0ba34a79-e74b5b82-3bab-92b0e55bd759 0ba34a79-e74b5b82-3bab-92b0e55bd759 true vfat 261853184 261844992
/vmfs/volumes/530b0db9-4c5af808-79b3-001e0b74044c 530b0db9-4c5af808-79b3-001e0b74044c true vfat 299712512 114974720

 

 

esxcli storage core adapter list

 

vmhba0 ata_piix link-n/a ide.vmhba0 (0:0:31.1) Intel Corporation 631xESB/632xESB IDE Controller
vmhba1 cciss link-n/a block.cciss/c0d1:0 (0:6:0.0) Hewlett-Packard Company Smart Array P400
vmhba2 mptspi link-n/a pscsi.vmhba2 (0:18:2.0) LSI Logic / Symbios Logic 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI
vmhba3 cciss link-n/a block.cciss/c1d0:0 (0:19:4.0) Compaq Computer Corporation Smart Array 6400
vmhba32 ata_piix link-n/a ide.vmhba32 (0:0:31.1) Intel Corporation 631xESB/632xESB IDE Controller
vmhba33 iscsi_vmk online iscsi.vmhba33 iSCSI Software Adapter

 

paulvz_0-1627331440830.png

storage.png

vsphere version 5.0.0

vmware esxi 5.0.0

 

 

hp proliant dl380 gs

8 cpu *2.33ghz

hyperthreading insactive

state connected

 

Reply
0 Kudos
paulvz
Contributor
Contributor

Product: VMware vSphere 5 Essentials Licensed for 2 physical CPUs (unlimited cores per CPU)
License Key: 050xx-xxxxx-xxxxx-xxxxx-xxx91J
Expires: Never

Product Features:
Up to 8-way virtual SMP
vCenter agent for VMware host
vStorage APIs
VMsafe

 

mpx.vmhba1:C0:T1:L0

mpx.vmhba1:C0:T0:L0

mpx.vmhba3:C0:T0:L0

 

Moderator Note: Do not post license keys! I've modified the key with.

Reply
0 Kudos
paulvz
Contributor
Contributor

53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/ just missing - 

Reply
0 Kudos
paulvz
Contributor
Contributor

VMhost.iretire.co.za VMware ESXi, 5.0.0, 469512

General 
Manufacturer:HP
Model:ProLiant DL380 G5
Processors:8 CPU x 2.333 GHz
Processor Type:Intel(R) Xeon(R) CPU E5345 @ 2.33GHz
Hyperthreading:Inactive
Total Memory:6.00 GB
Number of NICs:2
State:Connected
Virtual Machines:3
vMotion Enabled:No
Active Tasks 
Resources 
CPU Utilization:
0% 
          
Memory Utilization:
15% 
          
Datastores 
datastore1:Capacity: 131.75 GB (74.80 GB free)
Test VM:Capacity: 683.25 GB (1.99 GB free)
Networks 
VM Network
Reply
0 Kudos
e_espinel
Virtuoso
Virtuoso

Hello.
The requested is the Datastores and devices view of the ESXi host
the path is configuration -> Storage ->datastores
here it should show a list and they should be there:
datstore1 and test VM
another view is
the path is configuration -> Storage ->devices

The good thing is that all the filesystems that ESXi sees are mounted (column four in the first command).

From what I send you would only have 3 VMs and they would be in the directory
/vmfs/volumes/530b15c1-419f0a24-c186-001e0b74044c
enter in that directory in the SSH session and execute the command
df -h

 

 

Translated with www.DeepL.com/Translator (free version)

 

Enrique Espinel
Senior Technical Support on IBM, Lenovo, Veeam Backup and VMware vSphere.
VSP-SV, VTSP-SV, VTSP-HCI, VTSP
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
Tags (1)
Reply
0 Kudos
paulvz
Contributor
Contributor

theyare there.

 

53183321-39a19653-750f-001e0b74044c/Iretire-RemotePastel/ just missing -  my datastore called Iretire-RemotePastel is gone. not there. not in disks

Reply
0 Kudos
paulvz
Contributor
Contributor

/vmfs # ls devices volumes /vmfs # cd volumes/ /vmfs/volumes # ls 0ba34a79-e74b5b82-3bab-92b0e55bd759 530b0dc0-04aa818e-cc22-001e0b74044c 530b15c1-419f0a24-c186-001e0b74044c Test VM 530b0db9-4c5af808-79b3-001e0b74044c 530b0dc1-690860d9-b8e1-001e0b74044c 9e1ab57a-0af0c710-0636-13a656d621fc datastore1 /vmfs/volumes # df -h Filesystem Size Used Available Use% Mounted on VMFS-5 131.8G 56.9G 74.8G 43% /vmfs/volumes/datastore1 VMFS-5 683.2G 681.3G 2.0G 100% /vmfs/volumes/Test VM vfat 4.0G 120.8M 3.9G 3% /vmfs/volumes/530b0dc1-690860d9-b8e1-001e0b74044c vfat 249.7M 127.5M 122.3M 51% /vmfs/volumes/9e1ab57a-0af0c710-0636-13a656d621fc vfat 249.7M 8.0K 249.7M 0% /vmfs/volumes/0ba34a79-e74b5b82-3bab-92b0e55bd759 vfat 285.8M 176.2M 109.6M 62% /vmfs/volumes/530b0db9-4c5af808-79b3-001e0b74044c /vmfs/volumes # cd 530b15c1-419f0a24-c186-001e0b74044c/ /vmfs/volumes/530b15c1-419f0a24-c186-001e0b74044c # df -h Filesystem Size Used Available Use% Mounted on VMFS-5 131.8G 56.9G 74.8G 43% /vmfs/volumes/datastore1 VMFS-5 683.2G 681.3G 2.0G 100% /vmfs/volumes/Test VM vfat 4.0G 120.8M 3.9G 3% /vmfs/volumes/530b0dc1-690860d9-b8e1-001e0b74044c vfat 249.7M 127.5M 122.3M 51% /vmfs/volumes/9e1ab57a-0af0c710-0636-13a656d621fc vfat 249.7M 8.0K 249.7M 0% /vmfs/volumes/0ba34a79-e74b5b82-3bab-92b0e55bd759 vfat 285.8M 176.2M 109.6M 62% /vmfs/volumes/530b0db9-4c5af808-79b3-001e0b74044c /vmfs/volumes/530b15c1-419f0a24-c186-001e0b74044c # ls -l drwxr-xr-x 1 root root 2520 Jul 26 11:03 Test VM

Reply
0 Kudos
scott28tt
VMware Employee
VMware Employee

What did VMware technical support say when you opened a request with them?

 


-------------------------------------------------------------------------------------------------------------------------------------------------------------

Although I am a VMware employee I contribute to VMware Communities voluntarily (ie. not in any official capacity)
VMware Training & Certification blog
Reply
0 Kudos
paulvz
Contributor
Contributor

hi there -  i have not opened a ticket yet- should do that hey

Reply
0 Kudos
pkvmw
VMware Employee
VMware Employee

@scott28tt @paulvz 
For ESXi 5.0 the "End Of General Support" was 24th of August 2016, where "End of Technical Guidance" ended on 24h of August 2018. There is no support provided for this very old release anymore, hence no official support is provided anymore.

So I'd recommend getting newer, supported hardware and ESXi version.

@paulvz Also you might want not to post internal hostnames in a public community forum.

What is the missing datastore and how was it presented to the ESXi host? If it was via iSCSI, I'd recommend checking the iSCSI configuration from the ESXi host as well as from the storage underneath.

Reply
0 Kudos
scott28tt
VMware Employee
VMware Employee

@pkvmw I didn't check the version number being used, yes a long time out of support.

@paulvz If you are running anything like production workloads, you really should consider updating your software platform.

 


-------------------------------------------------------------------------------------------------------------------------------------------------------------

Although I am a VMware employee I contribute to VMware Communities voluntarily (ie. not in any official capacity)
VMware Training & Certification blog
Reply
0 Kudos