VMware Cloud Community
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

Not able to provision VM on Remote site,machine failed at CLONE MACHINE state.

This is a vRA 7.4 distributed deployment.At primary site ,i am able to provision VM without any issue but at remote site i am getting an error i.e. Error processing [CloneVM], error details:  Cannot locate the virtual machine or template with name.I have tried clone from template as well as linked clone.

load balancer ,vRA appliances and IAAS components are placed at primary site however two proxy agents placed at remote site wherein i am facing an issue.

Stack Trace

at DynamicOps.Vrm.Agent.vSphere.VSphereGetMachineByNameRequest.CheckTooFewVirtualMachinesFound(Int32 count)

at DynamicOps.Vrm.Agent.vSphere.VSphereGetMachineByNameRequest.GetMachineMoRef()

at DynamicOps.Vrm.Agent.vSphere.VSphereGetMachineByNameRequest.ExecuteImpl()

at DynamicOps.Vrm.Agent.vSphere.VSphereHypervisorServiceProvider.GetMachineByName(ManagementEndpoint managementEndpoint, String name)

at DynamicOps.Vrm.Agent.vSphere.VSphereAgentService.CreateLinkedClone(WorkItem workItem, PropertyBagHelper propertyBagHelper)

at DynamicOps.Vrm.Agent.BaseHypervisorAgent`3.ProcessWorkitem(WorkItem workItem, String task, PropertyBagHelper propertyBag)

at DynamicOps.Vrm.Agent.vSphere.VSphereAgentService.ProcessWorkitem(WorkItem workItem, String task, PropertyBagHelper propertyBag)

at DynamicOps.Vrm.Agent.BaseAgent.ProcessWorkitem(WorkItem workItem)

Reply
0 Kudos
1 Solution

Accepted Solutions
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

Thanks for your help.

But now this issue has been resolved by disable and enable the manager service's nodes in load balancer.

View solution in original post

Reply
0 Kudos
10 Replies
daphnissov
Immortal
Immortal
Jump to solution

It seems like it's not finding a template with the name you specified in the blueprint at the remote site. Are you certain the name is the same? If so, please show some screenshots of your configuration/environment.

Reply
0 Kudos
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

I have created new template and same has been discovered in compute resource.please find the attached screenshot.

Reply
0 Kudos
daphnissov
Immortal
Immortal
Jump to solution

Do you have multiple vSphere endpoints configured? If so, how are you directing your blueprint to one versus the other? If you choose another template in that blueprint and provision, does it succeed?

Reply
0 Kudos
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

Yes, i have two vsphere endpoints.One for primary and other is for remote site.

Pointing to remote site's reservation in blueprint.

Changed to another template but still issue remain same.

Please find the below logs wherein i got an error at 2019-02-03T06:58:30.

2019-02-03T06:58:30.444Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="3048"] [sub-thread-Id="14"  context=""  token=""] Starting Ping Report

2019-02-03T06:58:33.446Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="3048"] [sub-thread-Id="14"  context=""  token=""] Ping Sent Successfully : [<?xml version="1.0" encoding="utf-16"?><pingReport agentName="mglvsavctpv002" agentVersion="7.4.0.0" agentLocation="APWLVSIPAPV001" WorkitemsProcessed="100"><Endpoint externalReferenceId="682cdb7a-6a4f-42f8-bfc9-4621ae13f51c" productName="VMware vCenter Server" version="6.5.0" licenseName="VMware vCenter Server 6 Standard" /><ManagementEndpoint Name="vc-mglvsavctpv002" /><Nodes><Node name="LVS_SQLPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_SQLPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c6833" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_ORAPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_ORAPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c4900" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD06" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD06" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c6027" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_XD_VDI01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_XD_VDI01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c3320" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD04" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD04" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2305" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_XD_SRV01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_XD_SRV01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c3446" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c314" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_LNXPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_LNXPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c318" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD05" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD05" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c4585" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD02" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD02" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2143" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_NSXEDGE" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_NSXEDGE" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c115" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINNONPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINNONPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2071" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_LNXNONPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_LNXNONPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2598" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD03" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD03" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2224" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /></Nodes><AgentTypes><AgentType name="Hypervisor" /><AgentType name="vSphereHypervisor" /></AgentTypes></pingReport>]

2019-02-03T06:58:33.446Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="3048"] [sub-thread-Id="14"  context=""  token=""] Ping Report Completed

2019-02-03T06:59:33.462Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4308"] [sub-thread-Id="15"  context=""  token=""] Starting Ping Report

2019-02-03T06:59:36.277Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4308"] [sub-thread-Id="15"  context=""  token=""] Ping Sent Successfully : [<?xml version="1.0" encoding="utf-16"?><pingReport agentName="mglvsavctpv002" agentVersion="7.4.0.0" agentLocation="APWLVSIPAPV001" WorkitemsProcessed="100"><Endpoint externalReferenceId="682cdb7a-6a4f-42f8-bfc9-4621ae13f51c" productName="VMware vCenter Server" version="6.5.0" licenseName="VMware vCenter Server 6 Standard" /><ManagementEndpoint Name="vc-mglvsavctpv002" /><Nodes><Node name="LVS_SQLPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_SQLPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c6833" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_ORAPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_ORAPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c4900" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD06" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD06" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c6027" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_XD_VDI01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_XD_VDI01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c3320" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD04" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD04" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2305" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_XD_SRV01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_XD_SRV01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c3446" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c314" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_LNXPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_LNXPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c318" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD05" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD05" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c4585" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD02" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD02" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2143" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_NSXEDGE" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_NSXEDGE" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c115" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINNONPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINNONPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2071" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_LNXNONPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_LNXNONPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2598" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD03" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD03" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2224" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /></Nodes><AgentTypes><AgentType name="Hypervisor" /><AgentType name="vSphereHypervisor" /></AgentTypes></pingReport>]

2019-02-03T06:59:36.277Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4308"] [sub-thread-Id="15"  context=""  token=""] Ping Report Completed

2019-02-03T07:00:36.292Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4524"] [sub-thread-Id="23"  context=""  token=""] Starting Ping Report

2019-02-03T07:00:39.050Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4524"] [sub-thread-Id="23"  context=""  token=""] Ping Sent Successfully : [<?xml version="1.0" encoding="utf-16"?><pingReport agentName="mglvsavctpv002" agentVersion="7.4.0.0" agentLocation="APWLVSIPAPV001" WorkitemsProcessed="100"><Endpoint externalReferenceId="682cdb7a-6a4f-42f8-bfc9-4621ae13f51c" productName="VMware vCenter Server" version="6.5.0" licenseName="VMware vCenter Server 6 Standard" /><ManagementEndpoint Name="vc-mglvsavctpv002" /><Nodes><Node name="LVS_SQLPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_SQLPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c6833" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_ORAPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_ORAPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c4900" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD06" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD06" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c6027" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_XD_VDI01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_XD_VDI01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c3320" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD04" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD04" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2305" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_XD_SRV01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_XD_SRV01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c3446" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c314" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_LNXPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_LNXPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c318" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD05" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD05" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c4585" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD02" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD02" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2143" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_NSXEDGE" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_NSXEDGE" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c115" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINNONPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINNONPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2071" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_LNXNONPROD01" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_LNXNONPROD01" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2598" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /><Node name="LVS_WINPROD03" type="Cluster" identity="mglvsavctp002.sempra.com/LVS_APPS/host/LVS_WINPROD03" datacenterExternalReferenceId="datacenter-21" externalReferenceId="domain-c2224" isCluster="True" managementEndpointId="06a9e71a-21b6-4904-aea0-5050e58b08fb" /></Nodes><AgentTypes><AgentType name="Hypervisor" /><AgentType name="vSphereHypervisor" /></AgentTypes></pingReport>]

2019-02-03T07:00:39.050Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4524"] [sub-thread-Id="23"  context=""  token=""] Ping Report Completed

2019-02-03T07:01:39.061Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4524"] [sub-thread-Id="23"  context=""  token=""] Starting Ping Report

2019-02-03T07:01:41.986Z APWLVSIPAPV001 vcac: [component="iaas:VRMAgent.exe" priority="Debug" thread="4524"] [sub-thread-Id="23"  context=""  token=""] Ping Se

Reply
0 Kudos
daphnissov
Immortal
Immortal
Jump to solution

Have you ever been able to deploy templates from that endpoint, or is this a new issue? Does it work for any templates in that site? These templates that fail...are they clones from other templates on the site that works?

Reply
0 Kudos
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

Have you ever been able to deploy templates from that endpoint, or is this a new issue? No ,this is the first time i am trying to deploy the machine at remote site

Does it work for any templates in that site? No

These templates that fail...are they clones from other templates on the site that works?None of the VM deployed yet from any template at remote site.

Reply
0 Kudos
daphnissov
Immortal
Immortal
Jump to solution

Have you created reservations at this secondary site?

When I asked this:

These templates that fail...are they clones from other templates on the site that works?None of the VM deployed yet from any template at remote site.

I meant the templates that are at the secondary site. Did you create them by cloning other templates/VMs that existed at the primary site as opposed to creating them as new virtual machines?

Reply
0 Kudos
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

Yes, i have created the reservation at remote site.

Did you create them by cloning other templates/VMs that existed at the primary site as opposed to creating them as new virtual machines? No , i didn't but i have created new templates twice at remote site.

Reply
0 Kudos
daphnissov
Immortal
Immortal
Jump to solution

Some more questions and steps:

  1. What version of vCenter at the remote site?
  2. Try this:
    1. Convert that oracle template back to a VM.
    2. Run a data collection.
    3. Ensure template disappears from the list of templates when choosing one for the blueprint.
    4. Right-click and remove from inventory.
    5. Re-add to inventory.
    6. Convert back to template.
    7. Perform data collection.
    8. Ensure template now shows in the available templates list.
    9. Attempt a deployment.
    10. Does this succeed?
Reply
0 Kudos
Gajendrapundier
Enthusiast
Enthusiast
Jump to solution

Thanks for your help.

But now this issue has been resolved by disable and enable the manager service's nodes in load balancer.

Reply
0 Kudos