VMware Cloud Community
Ma5ek
Contributor
Contributor

Could not power on VM : Invalid metadata - storage

Hi,

I am new at this forum and I have problems starting VM. My configuration of esx 4.1 is :

- two host in cluster ( esx1 and esx2 ) HA

- datastore is on DELL MD storage conected via ISCSII

When I try to start VM on esx1 I get this error:

Failed to power on VM

Could not power on VM : Invalid metadata.

If I migrate host to esx2 the VM power ON without any errors. When the VM is on I can migrate host back to esx1 and it works normaly until first shutdown. Then I have to repeat the procedure.

Can you help me to resolve this problem ?

Thanks,

Alan

Reply
0 Kudos
22 Replies
prabuvmware
Enthusiast
Enthusiast

Can you paste the VMkernel logs?

Reply
0 Kudos
a_p_
Leadership
Leadership

Welcome to the Community,

please see whether http://kb.vmware.com/kb/1030719 can help.

André

Reply
0 Kudos
admin
Immortal
Immortal

Where is the swap file for VM getting created . is it on same datastore as VM directory or another one

Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

I have checked the settings and the swap files are in the same directory as the VM. I will attach log files - vmware-7 is log file from VM and syslog are logs from esx1. If this are not logs you nedd please tell me.

Thanks,

Alan

Reply
0 Kudos
admin
Immortal
Immortal

Is this is the only VM from that datastore facing this issue? Or multiple VMs? Also try to create a file inside the VM folder and see if that allow you to create files.

If this is a Metadata corruption then you have to contact VMware Support to fix the metadata corruption.

Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

This error is on any VM on host esx1. If I migrate VM to different host ( in my case esx2) the VM strats normaly. I can also create or delete files in side VM folder.

Alan

Reply
0 Kudos
julienvarela
Commander
Commander

Hi,

Are you able to browse your datastore and create a file from your esx1? 

Then try this, power on your VM on esx2, and then , migrate this VM using vMotion to esx1, is this works?

Regards,

Julien.

Regards, J.Varela http://vthink.fr
Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

Yes I can browse the store and I can create files on esx1, esx2 - localstore and on Dell MD Storage store. If I power VM on ESX2 and migrate to ESX1 then it works - until I have to restart VM on ESX1.

Regards,

Alan

Reply
0 Kudos
julienvarela
Commander
Commander

Hi,

I see this on your log files

"[2013-07-17 13:43:17.723 F5670B90 info 'ha-eventmgr'] Event 2890 : At least one corrupt resource metadata region was detected on volume 4d1c7cab-1c64ceea-1298-0010188b4918 (VM_Store). Other regions of the volume might be damaged too."

Your volume is corrupted.

assuming to this, you need to delete the datastore, delete the Lun from your storage area. Then, create a new lun and re-create your datastore.

Just before, so can you move your vm on another datastore and try to make the same operation?

Regards,

Julien.

Regards, J.Varela http://vthink.fr
Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

Thank you for your advice. I will try it tommorow, because I am at home wright now. Can you tell me or do you have any clue why is it working on esx2 but not on esx1 where the VM_store is on DELL MD 3000 storage, so both ESX1 and ESX2 share the same datastore ?

Regards

Alan

Reply
0 Kudos
julienvarela
Commander
Commander

Hi,

Good point, but i haven't the logical answer Smiley Happy.But i will take a look.

Ok no problem lets try and tell me if it is ok.

Regards,

Julien.

Regards, J.Varela http://vthink.fr
Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

Thank you for you time. I will try tommorow and report.

Regards.

Alan

Reply
0 Kudos
admin
Immortal
Immortal

As I said before contact VMware support if you have valid agreement. Certain Metadata corruption can be fixed by VMware. VMware help you to take the metadata dump and they will check it whether they can fix the metadata. If they are saying that not fixable then you can go ahead and format the LUN. Make sure you have valid backup of your VMs

Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

I have just test and move one of VM from MD3000 storage to localstore of ESX1 and the VM turn it on normaly. I can not migrate the machine to esx2, because local store of ESX1 is not shared with ESX2. I have also noticed that ESX 4.1 in cluster is not updated ( basic instalation without updates ). So my actions will be :

1. Fully update ESX 4.1 cluster

2. If this does not work I will contact VMware support as AT10 said

3. If they can not help me then the last option format the VM store and delete LUN from MD3000 Store

But I will also need your help. How can I update cluster ? I have allready installed update manager on vsphare. I will install only updates for ESXi ( without Linux or Windows VM updates ). What is the procedure for updating ESXi 4.1 cluster ?

Regards, Alan

Reply
0 Kudos
julienvarela
Commander
Commander

Hi,

You can find here a documentation for upgrade your ESXi. http://www.vmware.com/pdf/vsphere4/r41/vsp_41_upgrade_guide.pdf

But major step are :

- 1 Check if your host are compatible 4.1 using HCL. VMware Compatibility Guide: System Search

- 2 Upgrade your vCenter to vCenter 4.1 

- 3 Put one host to maintenance mode.

- 4 Upgrade this host using update manager or using update ISO.  VMware vSphere 4: Private Cloud Computing, Server and Data Center Virtualization

- 5 Repeat 3-4 for all your host.

regards,

Julien.

Regards, J.Varela http://vthink.fr
Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

I have ESX 4.1 on both hosts ( 4.1.0., 260247 ) and vspahare client/server version 4.1.0 build 258902. I just need to instal critical patches for esx 4.1.0

Could you help me with the procedure ?

Regards

Alan

Reply
0 Kudos
julienvarela
Commander
Commander

Hi,

So you need to have vCenter update manager installed.

  • Then go to update manager administration and create a new baseline , type a name and select host patch :

pastedImage_0.png

  • Select dynamic patch option and select product as needed. (Here in Severity , select critical, if you need only critical patch).

pastedImage_1.png

  • Then leave by default and click on finish.
  • After you need to attach your baseline to your cluster. So select your cluster, go to update manager tab and click on "Attach" and select your baseline previously created.-
  • Right click on your cluster and click on "Scan for update".
  • Select a host, put it in maintenance mode. Then right click and remediate.

Et voila Smiley Wink

Regards,

Julien.

Regards, J.Varela http://vthink.fr
Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi,

Thank you - you are the man Smiley Happy .

I will report - probably I will do the work over the weekend.

Thanks again,

Regard

Alan

Reply
0 Kudos
Ma5ek
Contributor
Contributor

Hi everyone,

I have updated ESXi 4.1 with latest updates. The problem still remains. But I have noticed, that problem remain only on certain VM. I will try to contact Vmware, but I do not have support anymore. By your experiance, will they help me anywhey ?

Regards, Alan

Reply
0 Kudos