VMware Cloud Community
Derrick888
Contributor
Contributor
‎04-06-2014 09:34 PM

vApp was suddenly suspend in random time automatically.

Hi All,

My vApp in vcloud director 5.1.2 was being suspended in random time. And I got the log from vcloud director log on that time. I found that the vApp is automatically undeploying.

Anyone can give a hand to troubleshoot this issue.

Thanks in advance

2014-04-05 11:00:50,925 | DEBUG    | Quartz-pool-1-thread-10994 | AgentStateCheckJob             | Executing agent check job |

2014-04-05 11:00:50,928 | DEBUG    | Quartz-pool-1-thread-10994 | AgentStateCheckJob             | Number of prepared hung hosts is 0 |

2014-04-05 11:00:50,954 | DEBUG    | Quartz-pool-1-thread-10994 | SamlMessageStorageCleanerJob   | Executing SAML message storage cleanup job. |

2014-04-05 11:00:50,955 | DEBUG    | Quartz-pool-1-thread-10994 | HibernateSamlMessageStorageDao | Deleting cached SAML messages older than 4/5/14 10:30 AM |

2014-04-05 11:00:50,956 | DEBUG    | Quartz-pool-1-thread-10994 | HibernateSamlMessageStorageDao | Deleted old SAML messages row count: 0 |

2014-04-05 11:00:50,957 | DEBUG    | Quartz-pool-1-thread-10994 | SamlMessageStorageCleanerJob   | Completed SAML message storage cleanup job. |

2014-04-05 11:00:50,988 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Executing DB cache refresh job. |

2014-04-05 11:00:50,988 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Executing stored procedures [populate_cached_vdc_metrics, populate_cached_sc_metrics, populate_cached_pvdc_metrics, populate_cached_vdc_sp_metrics] |

2014-04-05 11:00:51,007 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Executed cache referesh stored procedure populate_cached_vdc_metrics. Took 19 ms. |

2014-04-05 11:00:51,012 | DEBUG    | Quartz-pool-1-thread-10995 | LeaseManagementJob             | Executing lease management job |

2014-04-05 11:00:51,032 | DEBUG    | Quartz-pool-1-thread-10996 | MasterTimerJob                 | Executing Master timer job |

2014-04-05 11:00:51,039 | DEBUG    | Quartz-pool-1-thread-10995 | ResourceCleanupManager         | Automatically undeploying configuration saving state: vApp (780bee88-82fc-4666-86ed-ada80e658aec) |

2014-04-05 11:00:51,050 | DEBUG    | Quartz-pool-1-thread-10997 | SpbmCollectorJob               | Executing spbm collector job |

2014-04-05 11:00:51,084 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Executed cache referesh stored procedure populate_cached_sc_metrics. Took 76 ms. |

2014-04-05 11:00:51,094 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Executed cache referesh stored procedure populate_cached_pvdc_metrics. Took 10 ms. |

2014-04-05 11:00:51,101 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Executed cache referesh stored procedure populate_cached_vdc_sp_metrics. Took 7 ms. |

2014-04-05 11:00:51,101 | DEBUG    | Quartz-pool-1-thread-10994 | DatabaseCacheRefreshJob        | Finished DB cache refresh job. Took 113ms |

2014-04-05 11:00:51,127 | DEBUG    | Quartz-pool-1-thread-10997 | SpbmCollectorServiceImpl       | SPBM is not supported for VC-0eea68d3-c9a5-4f20-a62a-8e06ed2b051b |

2014-04-05 11:00:51,171 | DEBUG    | Quartz-pool-1-thread-10997 | DiagnosticHelperFactory        | Operation com.vmware.vcloud.common.lock.impl.ObjectLockServiceDbImpl.acquireIntent[1] took 44ms |

2014-04-05 11:00:51,173 | DEBUG    | Quartz-pool-1-thread-10997 | ObjectLockServiceDbImpl        | LOCK [EXCLUSIVE, virtual_center@0eea68d3-c9a5-4f20-a62a-8e06ed2b051b, thread@41788, cell@168] - first time |

2014-04-05 11:00:51,175 | DEBUG    | Quartz-pool-1-thread-10997 | DiagnosticHelperFactory        | Operation com.vmware.vcloud.common.lock.impl.ObjectLockServiceDbImpl.tryLockObjects[1] took 4ms |

2014-04-05 11:00:51,177 | DEBUG    | Quartz-pool-1-thread-10997 | DiagnosticHelperFactory        | Operation com.vmware.vcloud.common.lock.impl.ObjectLockServiceDbImpl.lock[1] took 50ms |

2014-04-05 11:00:51,177 | INFO     | Quartz-pool-1-thread-10997 | SpbmCollectorServiceImpl       | Starting collection of Spbm info on VC 0eea68d3-c9a5-4f20-a62a-8e06ed2b051b |

2014-04-05 11:00:51,177 | DEBUG    | Quartz-pool-1-thread-10997 | AbstractVlsiServiceBehavior    | instantiation VCenterVimVlsiServiceBehaviorImpl@61419f01 for key 0eea68d3-c9a5-4f20-a62a-8e06ed2b051b |

2014-04-05 11:00:51,230 | DEBUG    | Quartz-pool-1-thread-10995 | AbstractVAppImpl               | Undeploying vApp: id=780bee88-82fc-4666-86ed-ada80e658aec, name=vApp, creationStatus=RESOLVED, configurationType=1, orgId=ecd7a0b3-128d-4f2a-92d8-3e428ecd214d, vdc=[id=a8c5a256-aea7-40ef-acb6-25dbaf5e4eb3, name=ABC Org VDC, enabled=true, fastProvisioning=false, thinProivisioning=true, org=[id=ecd7a0b3-128d-4f2a-92d8-3e428ecd214d, name=ABC, displayName=ABC], providerVdc=[id=4cd92301-8d23-45c6-93fa-143df60ea40a, name=Production Provider VDC, highestSupportedHwVersion=9, vcenter=[[Id = 0eea68d3-c9a5-4f20-a62a-8e06ed2b051b, url = https://10.0.0.100:443/sdk, cell_instance_id = 168, uuid = 5EBB6863-4D67-4B33-9AB9-BB0573FB9F11, status = READY]]]] with options: com.vmware.ssdc.backend.interfaces.UndeployOptions@27799d30, undeployMode=Suspend, force=false, honorStartupSettings=false, undeployNetworks=true. VMs to be undeployed: 4 out of 4  |

2014-04-05 11:00:51,232 | DEBUG    | Quartz-pool-1-thread-10995 | VAppVmImpl                     | VAppVm: Undeploying: id=d6928f88-9f42-4a41-9f08-72e2bf2b2f93, name=ABC-HKV01, fabricIds=[svmId=bc5f60ed-be2c-4b04-8116-3437aa129fd2, cvmId=32a9754c-1968-4dc6-b4f7-b2cd0dfaea79, nvmId=4dfe318e-1ce8-4856-a6ca-346096e19aa7], vapp=[id=780bee88-82fc-4666-86ed-ada80e658aec, name=vApp, creationStatus=RESOLVED, configurationType=1, orgId=ecd7a0b3-128d-4f2a-92d8-3e428ecd214d, vdc=[id=a8c5a256-aea7-40ef-acb6-25dbaf5e4eb3, name=ABC Org VDC, enabled=true, fastProvisioning=false, thinProivisioning=true, org=[id=ecd7a0b3-128d-4f2a-92d8-3e428ecd214d, name=ABC, displayName=ABC], providerVdc=[id=4cd92301-8d23-45c6-93fa-143df60ea40a, name=Production Provider VDC, highestSupportedHwVersion=9, vcenter=[[Id = 0eea68d3-c9a5-4f20-a62a-8e06ed2b051b, url = https://10.0.0.100:443/sdk, cell_instance_id = 168, uuid = 5EBB6863-4D67-4B33-9AB9-BB0573FB9F11, status = READY]]]]], undeployMode=Suspend, delay=0, force=false |

2014-04-05 11:00:51,232 | DEBUG    | Quartz-pool-1-thread-10995 | JobManager                     | **** Doing operation JOB_UNDEPLOY on ABC-HKV01(com.vmware.vcloud.entity.vm:d6928f88-9f42-4a41-9f08-72e2bf2b2f93) |

2014-04-05 11:00:51,232 | DEBUG    | Quartz-pool-1-thread-10995 | JobString                      | Job object - Object : ABC-HKV01(com.vmware.vcloud.entity.vm:d6928f88-9f42-4a41-9f08-72e2bf2b2f93) operation name: JOB_UNDEPLOY |

2014-04-05 11:00:51,236 | DEBUG    | Quartz-pool-1-thread-10997 | AbstractVlsiServiceBehavior    | VCenterVimVlsiServiceBehaviorImpl@61419f01 https://10.0.0.100:443/sdk/vimService ServiceInstance:ServiceInstance ServiceInstance.retrieveContent: completionStatus=true |

2014-04-05 11:00:51,241 | DEBUG    | Quartz-pool-1-thread-10997 | AbstractVlsiServiceBehavior    | VCenterVimVlsiServiceBehaviorImpl@61419f01 https://10.0.0.100:443/sdk/vimService ServiceInstance:ServiceInstance ServiceInstance.retrieveInternalContent: completionStatus=true |

2014-04-05 11:00:51,246 | DEBUG    | Quartz-pool-1-thread-10997 | AbstractVlsiServiceBehavior    | VCenterVimVlsiServiceBehaviorImpl@61419f01 https://10.0.0.100:443/sdk/vimService ServiceInstance:ServiceInstance ServiceInstance.retrieveContent: completionStatus=true |

2014-04-05 11:00:51,250 | DEBUG    | Quartz-pool-1-thread-10997 | AbstractVlsiServiceBehavior    | VCenterVimVlsiServiceBehaviorImpl@61419f01 https://10.0.0.100:443/sdk/vimService ServiceInstance:ServiceInstance ServiceInstance.retrieveInternalContent: completionStatus=true |

2014-04-05 11:00:51,291 | DEBUG    | Quartz-pool-1-thread-10995 | CJob                           | Update last job       : [ABC-HKV01(com.vmware.vcloud.entity.vm:d6928f88-9f42-4a41-9f08-72e2bf2b2f93)], status=[1], [null] |

2014-04-05 11:00:51,324 | DEBUG    | Quartz-pool-1-thread-10995 | VAppVmImpl                     | Invoking action SUSPEND for virtual machine id=d6928f88-9f42-4a41-9f08-72e2bf2b2f93, name=ABC-HKV01, fabricIds=[svmId=bc5f60ed-be2c-4b04-8116-3437aa129fd2, cvmId=32a9754c-1968-4dc6-b4f7-b2cd0dfaea79, nvmId=4dfe318e-1ce8-4856-a6ca-346096e19aa7], vapp=[id=780bee88-82fc-4666-86ed-ada80e658aec, name=vApp, creationStatus=RESOLVED, configurationType=1, orgId=ecd7a0b3-128d-4f2a-92d8-3e428ecd214d, vdc=[id=a8c5a256-aea7-40ef-acb6-25dbaf5e4eb3, name=ABC Org VDC, enabled=true, fastProvisioning=false, thinProivisioning=true, org=[id=ecd7a0b3-128d-4f2a-92d8-3e428ecd214d, name=ABC, displayName=ABC], providerVdc=[id=4cd92301-8d23-45c6-93fa-143df60ea40a, name=Production Provider VDC, highestSupportedHwVersion=9, vcenter=[[Id = 0eea68d3-c9a5-4f20-a62a-8e06ed2b051b, url = https://10.0.0.100:443/sdk, cell_instance_id = 168, uuid = 5EBB6863-4D67-4B33-9AB9-BB0573FB9F11, status = READY]]]]] with delay 0 |

....

Best Rdgs,

Derrick

Reply
0 Kudos
2 Replies
cfor
Expert
Expert
‎04-07-2014 06:44 AM

Without knowing more this looks like what would happen when a vApp's lease expires.  (Or the server time is off and it thinks it should expire)

ChrisF (VCP4, VCP5, VCP-Cloud) - If you find this or any other answer useful please consider awarding points by marking the answer correct or helpful
Reply
0 Kudos
Derrick888
Contributor
Contributor
‎04-07-2014 07:59 PM

cfor, would you guide me to verify the lease expire setting. As I known, i didn't set that setting.

Reply
0 Kudos