v2 disk cannot work with v3 disk

[bad1]

Hi guys!

VSAN 6.2. Anyone having same issue?

[douglasarcidino]

So cormachogan‌ can and will chime in at some point but there are some bugs with the upgrade of the on disk format. The only way I could get the rest of my upgrade to finish was to power down some VMs. Last I heard, it was a CBT bug causing upgrade issues. Can you run the upgrade task and post a sanitized error message?

[CHogan]

This looks like you have upgraded ESXi and vCenter Server to 6.0U2, but have not upgraded the on-disk format so it is still at  V2. Consider upgrading them to V3.

Have you since tried to add new disks or hosts to the cluster, which will create disk groups with V3? You cannot have both.

[bad1]

Yes, ESXi and vCenter Server upgraded to 6.0 U2.

Deleted 2 disk groups and created new ones. Yes, they are version 3.

So, what is the right way to upgrade? Evacuate all data to other storage and then upgrade? :smileyconfused:

For other VSAN cluser, disk format version was shown 2.5, and I was able to have both versions(v2.5 & v3).

[CHogan · Accepted solution]

The on-disk format upgrade is done by clicking a button on the UI. You should not need to delete any disk groups. This does a rolling upgrade, evacuating one disk group at a time, in a rinse-and-repeat manner, while bringing the on-disk format up to V3.

Now you are left with a combination of V2 and V3 disk groups. VSAN cannot migrate objects from V2 directly to V3 because the objects are not aligned. This is what the interim V2.5 version does for you.

When everything is aligned and at V2.5, then you can do the rolling upgrade to V3.

Can you talk to support - I'm not sure what the best way to get you to V3 is now. They'll probably be able to give you some advice.