Converter Fails at 91%

[celinaadmin]

I have a physical server with a large disk structure. 1 volume is nearly 2TB and it takes 2 days to do the conversion.

I have ran it through the vCenter converter 3 times now and each time it fails at 91%

I've looked through the logs and find this error everytime. Does anyone have any idea what I'm doing wrong or if I have the job incorrectly configured?

2012-12-07T21:14:06.395-05:00 [01844 info 'Default'] Started task "task-7" for job="job-6", item ="1" -- void __thiscall Converter::Server::Job::JobProcessorImpl::StartProcessingJobs(void) ("d:/build/ob/bora-470252/bora/sysimage/lib/converter/server/job/jobProcessorImpl.cpp:383")

2012-12-07T21:14:06.426-05:00 [04756 info 'Default'] [task,338] [task-7] -- BEGIN -- Convert

2012-12-07T21:14:06.442-05:00 [04756 error 'Default'] Found dangling SSL error: [0] error:00000001:lib(0):func(0):reason(1)

2012-12-07T21:14:06.504-05:00 [01748 info 'Default'] ConverterConnection: KeepAlive timer canceled, StopKeepAlive succeeded

2012-12-07T21:14:06.598-05:00 [01748 info 'vmomi.soapStub[0]'] Resetting stub adapter for server PIPE:\\.\pipe\vmware-converter-worker-soap : Closed

2012-12-07T21:14:06.723-05:00 [04756 info 'Default'] [taskSpec,467] [task-7] [TaskMap] task-7:task-1

2012-12-09T15:47:42.483-05:00 [04756 error 'Default'] [task,350] [LRO] Unexpected Exception: converter.fault.CloneFault

2012-12-09T15:47:42.826-05:00 [04756 info 'Default'] [task,379] [task-7] -- ERROR -- Convert: converter.fault.CloneFault

--> (converter.fault.CloneFault) {

-->    dynamicType = <unset>,

-->    faultCause = (vmodl.MethodFault) null,

-->    description = "Unknown exception",

-->    msg = "",

--> }

2012-12-09T15:47:42.905-05:00 [04756 info 'Default'] [diagnosticManager,267] Retrieved taskInfo for "converter.task.Task:task-7" mapping it to "converter.task.Task:task-7".

2012-12-09T15:47:42.905-05:00 [04756 info 'Default'] [diagnosticManager,307] The task with id = "task-7" was found to be a "recent" task.

2012-12-09T15:47:42.905-05:00 [04756 info 'Default'] [diagnosticManager,321] No existing log bundle found for task with id = "task-7". The task is still "recent" so a log bundle will now be generated for it.

2012-12-09T15:47:42.936-05:00 [04756 info 'Default'] [diagnosticManager,790] Retrieving task related diagnostics for server task with id = "task-7".

2012-12-09T15:47:43.030-05:00 [01840 info 'Default'] Run 1 of job "job-6" finished with an error. -- struct Converter::Server::Job::JobExecutor::SchedulerUpdateSpec __thiscall Converter::Server::Conversion::ConversionJobExecutorImpl::UpdateJob(class Converter::Server::Job::InternalJob &,bool,const class Converter::Server::Scheduler::SchedulerItemStatistics &,const class Converter::Task::TaskInfo &) ("d:/build/ob/bora-470252/bora/sysimage/lib/converter/server/conversion/conversionJobExecutorImpl.cpp:405")

2012-12-09T15:47:43.076-05:00 [01840 info 'Default'] Suspended 1 scheduler items for job (job-6) -- void __thiscall Converter::Server::Job::JobProcessorImpl::SuspendJobAux(const class Converter::Server::Job::InternalJob &,class Converter::VdbConnection &) ("d:/build/ob/bora-470252/bora/sysimage/lib/converter/server/job/jobProcessorImpl.cpp:828")

2012-12-09T15:47:43.092-05:00 [01840 info 'Default'] Final cleanup of block-level tracking bitmaps for job "job-6". -- void __thiscall Converter::Server::Conversion::ConversionManagerImpl::OnDeactivate(const class Converter::Server::Job::InternalJob &,class Converter::VdbConnection &) ("d:/build/ob/bora-470252/bora/sysimage/ufad/server/conversionManagerImpl.cpp:1010")

2012-12-09T15:47:43.764-05:00 [04756 info 'Default'] ConverterConnection: KeepAlive timer canceled, StopKeepAlive succeeded

2012-12-09T15:47:43.842-05:00 [04756 info 'vmomi.soapStub[5]'] Resetting stub adapter for server PIPE:\\.\pipe\vmware-converter-worker-soap : Closed

2012-12-09T15:47:49.858-05:00 [01840 error 'Default'] Found dangling SSL error: [0] error:00000001:lib(0):func(0):reason(1)

2012-12-09T15:47:50.155-05:00 [01840 info 'Default'] ConverterConnection: KeepAlive timer canceled, StopKeepAlive succeeded

2012-12-09T15:47:50.155-05:00 [01840 info 'vmomi.soapStub[6]'] Resetting stub adapter for server PIPE:\\.\pipe\vmware-converter-worker-soap : Closed

2012-12-09T19:57:55.394-05:00 [01868 error 'Default'] Failed to send response to the client: The pipe is being closed.

Thanks in advanced

[nshetty]

Hello,

There is not much in the snippet that tells the cause for the converter failure.

I would like to see how far did the clone of the disk go before failure.

Could you please upload the  converter- server logs to understand the cause ?

Cheers,

NS

[celinaadmin]

Below is the whole log from this job. There is really nothing in there. The process nearly completes. See screenshot from the gui.

2012-12-10T09:27:40.247-05:00 [01696 info 'Default'] Connecting to host vcenter on port 443

2012-12-10T09:27:40.247-05:00 [01696 info 'Default'] localVersion is: vim.version.version7

2012-12-10T09:27:40.278-05:00 [01696 info 'Default'] Remote version is: vim.version.version7

2012-12-10T09:27:40.278-05:00 [01696 info 'Default'] Authenticating user administrator

2012-12-10T09:27:40.309-05:00 [01696 info 'Default'] Scheduled timer canceled, StopKeepAlive succeeds

2012-12-10T09:27:40.325-05:00 [01696 info 'vmomi.soapStub[1]'] Resetting stub adapter for server TCP:vcenter:443 : Closed

2012-12-10T09:27:40.356-05:00 [01696 info 'Default'] Connecting to host vcenter on port 443

2012-12-10T09:27:40.356-05:00 [01696 info 'Default'] localVersion is: vim.version.version7

2012-12-10T09:27:40.372-05:00 [01696 info 'Default'] Remote version is: vim.version.version7

2012-12-10T09:27:40.372-05:00 [01696 info 'Default'] Authenticating user administrator

2012-12-10T09:27:40.403-05:00 [01696 info 'Default'] ComputeResource for vim.HostSystem:host-568 is vim.ClusterComputeResource:domain-c26

2012-12-10T09:27:40.403-05:00 [01696 info 'Default'] ResourcePool for vim.ComputeResource:domain-c26 is vim.ResourcePool:resgroup-27

2012-12-10T09:27:40.403-05:00 [01696 info 'Default'] Reusing existing VIM connection to vcenter

2012-12-10T09:27:40.419-05:00 [01696 info 'Default'] Scheduled timer canceled, StopKeepAlive succeeds

2012-12-10T09:27:40.419-05:00 [01696 info 'vmomi.soapStub[2]'] Resetting stub adapter for server TCP:vcenter:443 : Closed

2012-12-10T09:27:40.419-05:00 [01696 info 'Default'] Connecting to host vcenter on port 443

2012-12-10T09:27:40.419-05:00 [01696 info 'Default'] localVersion is: vim.version.version7

2012-12-10T09:27:40.450-05:00 [01696 info 'Default'] Remote version is: vim.version.version7

2012-12-10T09:27:40.450-05:00 [01696 info 'Default'] Authenticating user administrator

2012-12-10T09:27:40.466-05:00 [01696 info 'Default'] Scheduled timer canceled, StopKeepAlive succeeds

2012-12-10T09:27:40.481-05:00 [01696 info 'Default'] ComputeResource for vim.ResourcePool:resgroup-27 is vim.ClusterComputeResource:domain-c26

2012-12-10T09:27:40.559-05:00 [01696 info 'vmomi.soapStub[3]'] Resetting stub adapter for server TCP:vcenter:443 : Closed

2012-12-10T09:27:40.559-05:00 [01696 info 'Default'] Created new scheduler item with id = "1", firstTimeToRun = "2012-12-10 09:27:40.419", source = "", targetRPOInMinutes = "0". -- __thiscall Converter::Server::Scheduler::SchedulerItemImpl::SchedulerItemImpl(const class Converter::Server::Scheduler::SchedulerItemSpec &,const int &,const class boost::shared_ptr<class Converter::Server::Scheduler::SchedulerEnv> &,const class Vmacore::Ref<class Vmacore::Service::Logger> &,const class boost::optional<class Converter::VdbConnection &> &) ("d:/build/ob/bora-875114/bora/sysimage/ufad/server/scheduler/schedulerItemImpl.cpp:87")

2012-12-10T09:27:40.559-05:00 [01696 info 'Default'] scheduler item with id="1" created -- int __thiscall Converter::Server::Scheduler::PriorityQScheduler::AddSchedulerItem(const class boost::shared_ptr<class Converter::Server::Scheduler::SchedulerItemSpec> &,const class boost::optional<class Converter::VdbConnection &> &) ("d:/build/ob/bora-875114/bora/sysimage/ufad/server/scheduler/priorityQScheduler.cpp:49")

2012-12-10T09:27:40.559-05:00 [04020 info 'Default'] Scheduler scheduling item 1 to run at time = 2012-12-10 09:27:40.559. -- void __thiscall Converter::Server::Scheduler::SimpleScheduler::Run(void) ("d:/build/ob/bora-875114/bora/sysimage/ufad/server/scheduler/simpleScheduler.cpp:109")

2012-12-10T09:27:40.653-05:00 [02980 info 'Default'] Connecting to host vcenter on port 443

2012-12-10T09:27:40.653-05:00 [02980 info 'Default'] localVersion is: vim.version.version7

2012-12-10T09:27:40.653-05:00 [02980 info 'Default'] Remote version is: vim.version.version7

2012-12-10T09:27:40.669-05:00 [02980 info 'Default'] Authenticating user administrator

2012-12-10T09:27:40.684-05:00 [02980 info 'Default'] ComputeResource for vim.HostSystem:host-2401 is vim.ClusterComputeResource:domain-c26

2012-12-10T09:27:40.684-05:00 [02980 info 'Default'] ResourcePool for vim.ComputeResource:domain-c26 is vim.ResourcePool:resgroup-27

2012-12-10T09:27:40.684-05:00 [02980 info 'Default'] Reusing existing VIM connection to vcenter

2012-12-10T09:27:40.716-05:00 [02980 info 'Default'] Scheduled timer canceled, StopKeepAlive succeeds

2012-12-10T09:27:40.716-05:00 [02980 info 'vmomi.soapStub[4]'] Resetting stub adapter for server TCP:vcenter:443 : Closed

2012-12-10T09:27:40.778-05:00 [02980 info 'Default'] Started task "task-8" for job="job-7", item ="1" -- void __thiscall Converter::Server::Job::JobProcessorImpl::StartProcessingJobs(void) ("d:/build/ob/bora-875114/bora/sysimage/lib/converter/server/job/jobProcessorImpl.cpp:383")

2012-12-10T09:27:40.794-05:00 [07772 info 'Default'] [task,338] [task-8] -- BEGIN -- Convert

2012-12-10T09:27:40.825-05:00 [01696 info 'Default'] ConverterConnection: KeepAlive timer canceled, StopKeepAlive succeeded

2012-12-10T09:27:40.841-05:00 [07772 error 'Default'] Found dangling SSL error: [0] error:00000001:lib(0):func(0):reason(1)

2012-12-10T09:27:40.841-05:00 [01696 info 'vmomi.soapStub[0]'] Resetting stub adapter for server PIPE:\\.\pipe\vmware-converter-worker-soap : Closed

2012-12-10T09:27:40.841-05:00 [01696 warning 'vmomi.soapStub[0]'] Terminating invocation: server=PIPE:\\.\pipe\vmware-converter-worker-soap, moref=converter.agent.AgentSessionManager:ConverterAgentSessionManager, method=logout

2012-12-10T09:27:41.028-05:00 [07772 info 'Default'] [taskSpec,467] [task-8] [TaskMap] task-8:task-1

2012-12-10T16:31:11.666-05:00 [06720 error 'Default'] Failed to send response to the client: The pipe is being closed.

2012-12-10T16:32:36.761-05:00 [07624 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-10T16:32:36.761-05:00 [07624 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-10T16:32:36.823-05:00 [07624 info 'Default'] [user,890] Successfully authenticated user USER ACCOUNT

2012-12-10T21:27:59.619-05:00 [06720 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-10T21:27:59.619-05:00 [06720 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-10T21:27:59.651-05:00 [06720 info 'Default'] [user,890] Successfully authenticated user USER ACCOUNT

2012-12-11T10:41:34.324-05:00 [05020 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-11T10:41:34.324-05:00 [05020 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-11T10:41:34.355-05:00 [05020 info 'Default'] [user,890] Successfully authenticated user USER ACCOUNT

2012-12-11T12:02:13.707-05:00 [04732 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-11T12:02:13.722-05:00 [04732 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-11T12:02:13.754-05:00 [04732 info 'Default'] [user,890] Successfully authenticated user USER ACCOUNT

2012-12-11T14:04:26.504-05:00 [05020 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-11T14:04:26.504-05:00 [05020 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-11T14:04:26.566-05:00 [05020 info 'Default'] [user,890] Successfully authenticated user USER ACCOUNT

2012-12-11T15:12:28.900-05:00 [07320 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-11T15:12:28.900-05:00 [07320 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-11T15:12:28.931-05:00 [07320 info 'Default'] [user,890] Successfully authenticated user

2012-12-11T17:11:01.085-05:00 [07248 info 'Libs'] [ADS] Account USER ACCOUNT found, but not local

2012-12-11T17:11:01.085-05:00 [07248 info 'Libs'] [ADS] GetTokenInformation failed: 1312

2012-12-11T17:11:01.100-05:00 [07248 info 'Default'] [user,890] Successfully authenticated user

2012-12-12T03:33:34.423-05:00 [07772 error 'Default'] [task,350] [LRO] Unexpected Exception: converter.fault.CloneFault

2012-12-12T03:33:34.627-05:00 [07772 info 'Default'] [task,379] [task-8] -- ERROR -- Convert: converter.fault.CloneFault

--> (converter.fault.CloneFault) {

-->    dynamicType = <unset>,

-->    faultCause = (vmodl.MethodFault) null,

-->    description = "Unknown exception",

-->    msg = "",

--> }

2012-12-12T03:33:34.673-05:00 [07772 info 'Default'] [diagnosticManager,267] Retrieved taskInfo for "converter.task.Task:task-8" mapping it to "converter.task.Task:task-8".

2012-12-12T03:33:34.673-05:00 [07772 info 'Default'] [diagnosticManager,307] The task with id = "task-8" was found to be a "recent" task.

2012-12-12T03:33:34.673-05:00 [07772 info 'Default'] [diagnosticManager,321] No existing log bundle found for task with id = "task-8". The task is still "recent" so a log bundle will now be generated for it.

2012-12-12T03:33:34.705-05:00 [07772 info 'Default'] [diagnosticManager,790] Retrieving task related diagnostics for server task with id = "task-8".

2012-12-12T03:33:34.720-05:00 [04960 info 'Default'] Run 1 of job "job-7" finished with an error. -- struct Converter::Server::Job::JobExecutor::SchedulerUpdateSpec __thiscall Converter::Server::Conversion::ConversionJobExecutorImpl::UpdateJob(class Converter::Server::Job::InternalJob &,bool,const class Converter::Server::Scheduler::SchedulerItemStatistics &,const class Converter::Task::TaskInfo &) ("d:/build/ob/bora-875114/bora/sysimage/lib/converter/server/conversion/conversionJobExecutorImpl.cpp:405")

2012-12-12T03:33:34.752-05:00 [04960 info 'Default'] Suspended 1 scheduler items for job (job-7) -- void __thiscall Converter::Server::Job::JobProcessorImpl::SuspendJobAux(const class Converter::Server::Job::InternalJob &,class Converter::VdbConnection &) ("d:/build/ob/bora-875114/bora/sysimage/lib/converter/server/job/jobProcessorImpl.cpp:828")

2012-12-12T03:33:34.752-05:00 [04960 info 'Default'] Final cleanup of block-level tracking bitmaps for job "job-7". -- void __thiscall Converter::Server::Conversion::ConversionManagerImpl::OnDeactivate(const class Converter::Server::Job::InternalJob &,class Converter::VdbConnection &) ("d:/build/ob/bora-875114/bora/sysimage/ufad/server/conversionManagerImpl.cpp:1010")

2012-12-12T03:33:34.923-05:00 [04960 error 'Default'] Found dangling SSL error: [0] error:00000001:lib(0):func(0):reason(1)

2012-12-12T03:33:35.142-05:00 [04960 info 'Default'] ConverterConnection: KeepAlive timer canceled, StopKeepAlive succeeded

2012-12-12T03:33:35.158-05:00 [04960 info 'vmomi.soapStub[6]'] Resetting stub adapter for server PIPE:\\.\pipe\vmware-converter-worker-soap : Closed

[continuum]

You tried a import of 2 TB drives 3 times already ?
You got nerves ...

Next time only import the minimum that you need for a bootable system - most of the times that is just the drive that has the C:\ partition.

For the large data volumes use a procedure that you can restart if it fails - robocopy for example.

Was the VM discarded  or do you still hhave the vmdks that were created ?

[celinaadmin]

I already have the VM in vmware for the C & D Drives which are less than 250GB, but am doing the P2V conversion so I can get the F Volume as a vmdk file so I can do snapshots, storage vmotion, replication, etc.

I could use a tool like robocopy to do the copy, but that will require downtime. The easiest way is to use the vmware converter, but I know that may not be an option. I just didn't know if I had something wrong that is a simple fix to correct. If not, I will manually move all the data.

As for the vmdk, I have that, but it seems to be corrupted as it doesn't attach to a virtual machine. I will also be missing all the remaining changes that occurred since the initial copy, so that is not a feasible option.

Thanks for the suggestions. Hopefully someone may have other ideas for getting the converter to work.

[continuum]

Why do you think that the source machine needs a downtime to use robocopy ?

The vmdks are not necessarily corrupted just because they are not connected to a VM.
First thing I would do is create a bogus herlper VM - attach the vmdk and boot into a LiveCD so that you inspect what is inside

[celinaadmin]

ok, so I guess I need to explain the function of this server and the data on it. This 2 TB Volume is full of the data from our document imaging system. Documents are being accessed from it throughout the day and new data is always being added at about a rate of 5GB per week. People are also going through old documents and annotating them and could make changes to any document. The reason I feel some downtime is needed is do to the fact that I have no good way to know what data has changed from the time I start copying documents over to when I have them all moved. Its much easier to just have the server unavailable to the users so I do not have to worry about change tracking. The problem is that it take more than 24 hours to copy 2 TB worth of data. I'll do more investigation with the vmdk files and see if they are usable and report back.

[continuum]

With robocopy you could copy the data while the server is busy.
That way you create the majority of files - then you would only use a short time to sync the latest changes