VMware

This Question is Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
5 Replies Last post: Aug 21, 2009 12:29 AM by bofh2  

Migrate Virtual machine: operation timed out - dest ip = <0.0.0.0> posted: Aug 20, 2009 5:46 AM

Click to view bofh2's profile Lurker 5 posts since
Aug 19, 2009
yesterday, I installed the following patches on aESXhost, using update manager:
  • vmkctl and vmkernel RPMs (ESX350-200906401-BG)
  • netXen Driver (ESX350-200906402-BG)
  • Kernel Source and VMNIX (ESX350-200906403-BG)
  • bnx2x Driver for Broadcom (ESX350-200906405-BG)
  • VMware Tools (ESX350-200906406-BG)
  • krb5 and pam-krb5 (ESX350-200906407-BG)
  • VMX RPM (ESX350-200906408-BG)
  • VMware Tools (ESX350-200907403-BG)
  • vmx RPM (ESX350-200907404-BG)
  • Kernel Source and VMNIX (ESX350-200907405-BG)
  • vmkernel and hostd RPMs (ESX350-200907407-BG)

After the machine has been patched:
  • I can no longer migrate RUNNING virtual machines to this host
  • I can migrate some, but not all, virtual machines that are powered down, and start it
  • Some powered down virtual machines, that are migrated to the patched host, simple migrate automatically to another host, when they are powered on.

the vmkernel.log file contains the following:
Aug 20 08:27:20 andedce0005m vmkernel: 0:01:23:34.215 cpu1:1035)World: vm 1092: 901: Starting world vmware-vmx with flags 4
Aug 20 08:27:20 andedce0005m vmkernel: 0:01:23:34.674 cpu1:1092)World: vm 1093: 901: Starting world vmm0:andedcw0008v with flags 8
Aug 20 08:27:20 andedce0005m vmkernel: 0:01:23:34.674 cpu1:1092)Sched: vm 1093: 5333: adding 'vmm0:andedcw0008v': group 'host/user': cpu: shares=-3 min=0 minLimit=-1 max=-1
Aug 20 08:27:20 andedce0005m vmkernel: 0:01:23:34.674 cpu1:1092)Sched: vm 1093: 5352: renamed group 22 to vm.1092
Aug 20 08:27:20 andedce0005m vmkernel: 0:01:23:34.674 cpu1:1092)Sched: vm 1093: 5366: moved group 22 to be under group 4
Aug 20 08:27:20 andedce0005m vmkernel: 0:01:23:34.679 cpu1:1092)Swap: vm 1093: 2169: extending swap to 2097152 KB
Aug 20 08:27:23 andedce0005m vmkernel: 0:01:23:37.806 cpu0:1092)Migrate: vm 1093: 7383: Setting migration info ts = 1250749634579448, src ip = <10.240.230.13> dest ip = <0.0.0.0> Dest wid = -1 using SHARED swap
Aug 20 08:27:23 andedce0005m vmkernel: 0:01:23:37.807 cpu0:1092)World: vm 1094: 901: Starting world migSendHelper-1093 with flags 1
Aug 20 08:27:23 andedce0005m vmkernel: 0:01:23:37.807 cpu0:1092)World: vm 1095: 901: Starting world migRecvHelper-1093 with flags 1
Aug 20 08:28:23 andedce0005m vmkernel: 0:01:24:37.811 cpu3:1092)WARNING: Migrate: 1346: 1250749634579448: Migration considered a failure by the VMX. It is most likely a timeout, but check the VMX log for the true error.
Aug 20 08:28:23 andedce0005m vmkernel: 0:01:24:37.811 cpu3:1092)WARNING: Migrate: 1243: 1250749634579448: Failed: Migration determined a failure by the VMX (0xbad0091) @0x9eb9b5

notice the "dest ip = <0.0.0.0>", i checked log entries from other migrations to other hosts, these entries list the vmkernel destination ip address, example:
Aug 19 14:45:46 andedce0004m vmkernel: 51:04:02:01.073 cpu3:1104)Migrate: vm 1105: 7383: Setting migration info ts = 1250685934801620, src ip = <10.240.230.13> dest ip = <10.240.230.14> Dest wid = 1075 using SHARED swap
the vmkernel network configuration for the problematic host however looks ok, at least, when looking at it, using virtual center client

I assume the problem is caused by one of the patches, any solution for this problem out there?
Click to view marcelo.soares's profile Expert 238 posts since
Jul 9, 2008
Hmmmmmmmmmmmmmmmmmm

Paste here the vmkernel log from both hosts in that time, and the vmware.log of the VM also at this time. Let's try to make someone guilty :-)

Marcelo Soares
VMWare Certified Professional 310
Technical Support Engineer
Linux Server Senior Administrator
Click to view Rajeev S's profile Hot Shot 193 posts since
Oct 27, 2006
If you restart the virtual center service and start the migration again .. does it happen?

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities