8 Replies Latest reply on Sep 4, 2018 1:04 AM by dirch201110141

    BlockLevelVolumeCloneMgr::CloneVolume: Error: 37409 (type: 1, code:  2338)'

    BarryDE Lurker

      Hi all,

       

      This ones got me a little stumped, hoping someone has some more experience.

       

      Source windows 2012 64bit (fresh deployment, test server for newbies in team)

      Converter version 6

      ESX 5.5

       

      I start conversion and fails at 3%~ with error.

       

      BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code:2338)'

       

      In worker logs all i can see is after the Worker InitialSyncFullCloneTask updates, state: 4, percentage: 3, xfer rate (Bps): 47285248 rows is as follows, no other errors - it just ends....

       

      2015-11-08T02:16:48.945-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] TargetVmManagerImpl::DeleteVM

      2015-11-08T02:16:48.945-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] Reusing existing VIM connection to 10.27.132.228

      2015-11-08T02:16:48.976-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] Destroying vim.VirtualMachine:83 on 10.27.132.228

      2015-11-08T02:16:49.241-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] WorkerConvertTask: Generating Agent Task bundle for task with id="task-1".

      2015-11-08T02:17:26.916-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] WorkerConvertTask: Retrieving agent task log bundle to "C:\Windows\TEMP\vmware-temp\vmware-SYSTEM\agentTask-task-1-vzohlwml.zip".

      2015-11-08T02:17:26.931-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] WorkerConvertTask: Bundle successfully retrieved to "C:\Windows\TEMP\vmware-temp\vmware-SYSTEM\agentTask-task-1-vzohlwml.zip".

      2015-11-08T02:17:26.931-06:00 error vmware-converter-worker[07764] [Originator@6876 sub=Default] Task failed:

       

      The only clue i can give thus far is that i received an ADMIN$ error when connecting initially, resolved by changing "Turn on network discovery" to on.


      There are no other errors in the worker log to give any clues, so far i have tried the following


      EDIT: Checked the agent log, found the following.

      Will review: VMware KB: Troubleshooting issues when vCenter Converter fails during conversion

      Will review 2: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2018582




      2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNetTcpRead: bRead: -1

      2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNet_Recv: requested 264, recevied only 0 bytes

      2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcGetMessage: recv failed:

      2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcFssrvr_IO: failed to receive io reply

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06348] [Originator@6876 sub=Default] Sysimgbase_DiskLib_Write failed with 'NBD_ERR_NETWORK_CONNECT' (error code:2338)

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06348] [Originator@6876 sub=task-1] TargetVolumeWriter::WriteToVolume(): Error (type: 1, code: 2338) writing 655360 bytes to the destination volume at offset 0x0000000037894000

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06348] [Originator@6876 sub=task-1] Converter::BackgroundWriter::WriteToVolume: Write failed with error 37409.

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::QueueItem: CircularBuffer AddItem error, destroy workItem!

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06348] [Originator@6876 sub=task-1] BackgroundWriter::ThreadFunc: Broadcasting "ThreadDone" condition.

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06348] [Originator@6876 sub=ThreadPool] Thread delisted

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] BlockLevelVolumeCloneMgr::CloneVolume: failed with exception BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] ScopedBackgroundWriter::~ScopedBackgroundWriter: Error in ReleaseBackgroundWriter 37409.

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] [StreamCacheWriter] - TotalZeros : 0, TotalWrites : 1331

      -->

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] SingleVolumeCloneTask:DoRun: Volume cloning failed with clone error BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

      2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] TaskImpl has failed with MethodFault::Exception: converter.fault.CloneFault

      2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] SingleVolumeCloneTask [source computer (unknown name)]-\WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00] --> [target VM (unknown name)]-3)=-;5;00000010000000000 updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] CompositeTask canceling #2 subtasks

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] TaskImpl issuing Cancel command

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] SingleVolumeCloneTask [source computer (unknown name)]-\WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00] --> [target VM (unknown name)]-3)=-;5;00000010000000000 updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] TaskImpl issuing Cancel command

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] SingleVolumeCloneTask [source computer (unknown name)]-\WindowsBitmapDriverVolumeId=[09-7B-3F-8E-00-00-10-00-00-00-00-00] --> [target VM (unknown name)]-90;7?3>(0000010000000000 updates, state: 0, percentage: 0, xfer rate (Bps): <unknown>

      2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNetTcpWrite: bWritten: -1

      2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcSendMessage: send failed: NFC_NETWORK_ERROR

      2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcFssrvr_Close: failed to send close message

      2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNetTcpWrite: bWritten: -1

      2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcSendMessage: send failed: NFC_NETWORK_ERROR

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] VolumeBasedCloneTask source computer (unknown name) --> target VM (unknown name) updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] VolumeBasedCloneTask failed

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] CloneTask updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

      2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] CloneTask failed

      2015-11-08T02:16:48.750-06:00 error vmware-converter-agent[04340] [Originator@6876 sub=Default] Task failed:

       


      Actions

      • Rerun job a couple more times - failed
      • Convert only C:\ - failed
      • Run Check disk /R on C:\ - failed


      Points to consider.

      • Next step would be to install converter locally but i want to avoid this for now.
      • No workarounds to be deployed, i.e. use acronis - must be able to proceed with converter alone
      • Normally a checkdisk resolves this issue for me.


      Question: What other things can cause the following error BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code:2338)'