Skip navigation
VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
1,550 Views 18 Replies Last post: Sep 2, 2009 4:49 AM by kefalak RSS
1 2 Previous Next
fmdj Enthusiast 42 posts since
Feb 16, 2007
Currently Being Moderated

Jul 30, 2009 2:39 AM

VMotion - free datastore space requirement

 

Hi,

 

 

since I have updated to vSphere CenterServer and ESX4 I can no longer vmotion some VMs. Especially those that have only little free space left on their datastore. VMotion fails with a message that there is not enough free space in the datastore. This worked fine with VC 2.5 and ESX3.5. Is there a new space requirement for vmotion?

 

 

It seems that I can only vmotion VMs that have at least so much space in their datastore avaliable as the size of their ram.

 

 

Thx

 

 

VirtualKenneth Master 1,514 posts since
May 10, 2006
Currently Being Moderated
1. Jul 30, 2009 2:58 AM in response to: fmdj
Re: VMotion - free datastore space requirement

Hmmmmm so let me get this right. You have, for example 2 VM's

 

VM1: 4 GB Memory

VM2: 8 GB Memory

 

Datastore1: 6 GB Free

 

So you can only VMotion VM1 and not VM2?

--- Kenneth van Ditmarsch Freelance Virtualization Architect (VCDX)
dburgess Hot Shot VMware Employees 98 posts since
May 23, 2005
Currently Being Moderated
2. Jul 30, 2009 2:59 AM in response to: fmdj
Re: VMotion - free datastore space requirement

 

Are your source systems using local disk for swap? Vmotion might  be trying to create vswap on the datastore. Normally in this config (you set loacl swap option) it will try and find a local vmfs on the target host and relocate the local swap file there. If it can't do that I beleive it then tries to locate the swap file with the vmx file.

 

 

 

 

 

dB

 

 

 

 

 

VirtualKenneth Master 1,514 posts since
May 10, 2006
Currently Being Moderated
3. Jul 30, 2009 3:10 AM in response to: dburgess
Re: VMotion - free datastore space requirement

See http://www.vmware.com/pdf/vsphere4/r40/vsp_40_admin_guide.pdf

 

page 96, Swapfile Location Compatibility

--- Kenneth van Ditmarsch Freelance Virtualization Architect (VCDX)
VirtualKenneth Master 1,514 posts since
May 10, 2006
Currently Being Moderated
5. Jul 30, 2009 4:55 AM in response to: fmdj
Re: VMotion - free datastore space requirement

I'm experiencing this same behaviour in my vSphere environment (both priority levels)

And i'm not seeing this in my ESX 3.5 environment. So this must indeed be a change

--- Kenneth van Ditmarsch Freelance Virtualization Architect (VCDX)
dburgess Hot Shot VMware Employees 98 posts since
May 23, 2005
Currently Being Moderated
6. Jul 30, 2009 6:22 AM in response to: VirtualKenneth
Re: VMotion - free datastore space requirement

 

We have tried to reproduce it here and did not see a new file created. Could be a special condition that is causing this. Are you monitoring the datastore while the vmotion is taking place. I'd be interested to see what you see, presumably for a period there are two vswap files present? Could you post a couple of screen shots?

 

 

 

 

 

dB

 

 

VirtualKenneth Master 1,514 posts since
May 10, 2006
Currently Being Moderated
7. Jul 30, 2009 6:26 AM in response to: dburgess
Re: VMotion - free datastore space requirement

Hi,

 

See screenshots attached... 1 is before, 2 is while vmotion is taking place

 

Kenneth

Attachments:
--- Kenneth van Ditmarsch Freelance Virtualization Architect (VCDX)
depping Champion VMware Employees User Moderators vExpert 4,238 posts since
Jan 17, 2005
Currently Being Moderated
8. Jul 30, 2009 7:11 AM in response to: VirtualKenneth
Re: VMotion - free datastore space requirement

that's weird.... but interesting though.

 

 

 

 

Duncan

VMware Communities User Moderator | VCP | VCDX

-


Blogging: http://www.yellow-bricks.com

Twitter: http://www.twitter.com/depping

 

If you find this information useful, please award points for "correct" or "helpful".

Duncan | Yellow-Bricks.com | Author of the vSphere 5.0 Clustering Deepdive
dburgess Hot Shot VMware Employees 98 posts since
May 23, 2005
Currently Being Moderated
9. Jul 30, 2009 7:21 AM in response to: VirtualKenneth
Re: VMotion - free datastore space requirement

Thanks - we have spotted it on our systems now so can reproduce.

VirtualKenneth Master 1,514 posts since
May 10, 2006
Currently Being Moderated
10. Jul 30, 2009 7:30 AM in response to: dburgess
Re: VMotion - free datastore space requirement

Maybe this has something to do with the changed behaviour of the .vswp

file under vSphere?

i.e. it's created on power-on and deleted when powered down.

--- Kenneth van Ditmarsch Freelance Virtualization Architect (VCDX)
dburgess Hot Shot VMware Employees 98 posts since
May 23, 2005
Currently Being Moderated
11. Jul 30, 2009 8:02 AM in response to: dburgess
Re: VMotion - free datastore space requirement

So - speaking with engineering. We always create this file, so that's new. It is only used if the target is under memory pressure. It is thin provisioned so  even though it looks the size of the memory it should have very little impact on the free space of the VMFS. Could be there is some other underlying problem with the storage. How much free space do you actually have available? And what is the exact error you get from VC. We may need vm-support dump to diagnose completely so might be best to raise an SR with support.

VirtualKenneth Master 1,514 posts since
May 10, 2006
Currently Being Moderated
12. Jul 30, 2009 8:16 AM in response to: dburgess
Re: VMotion - free datastore space requirement

Hi,

 

Thanks for the information. But how do you mean, a target host is pressured?

Does it deny a VMotion in case an ESX Host is already overcommited? (and is the function of creating this file to maybe check some things?)

I want the technicall stuff

 

Next to that, you are saying it's thin provisioned. But imagine the following scenario:

 

I've got an ESX Cluster with many VM's. The situation could occur in where 8 VM's are being VMotioned at the same time (same datastore).

Now these VM's all carry 8 GB memory which is totally used inside the guest. In that case I need 64 GB of very temporary space available in my datastore, right?

 

If so this all could result in a new math to calculate the datastore size.

 

Thanks so far!

 

Kenneth van Ditmarsch

--- Kenneth van Ditmarsch Freelance Virtualization Architect (VCDX)
dburgess Hot Shot VMware Employees 98 posts since
May 23, 2005
Currently Being Moderated
13. Jul 30, 2009 8:19 AM in response to: dburgess
Re: VMotion - free datastore space requirement

Here is a screen shot showing the vswp file using 0 blocks - if you are short of memory on the target this may be used so this could be the reason for the failure.

Attachments:
dburgess Hot Shot VMware Employees 98 posts since
May 23, 2005
Currently Being Moderated
14. Jul 30, 2009 8:39 AM in response to: VirtualKenneth
Re: VMotion - free datastore space requirement

 

So as far as I know you can only have two concurrent vmotions in flight at any one time. The other thing is that the temp swap will only be used for activity as the machine transistions so should not grow to the size of the memory. If you du the file systems you should see the the dick blocks being consumed. Engineers think this should be tops 400M even if it is used at all. By pressured we mean the amount of memory free is low. That will not deny the VM to vmotion unless we can't allocate enough reserved memory (this is zero by default). Once the transition is complete the VM reverts to the orginal swap file and the temp is deleted.

 

 

 

 

 

Bookmarked By (0)

Share This Page

Communities