VMware Cloud Community
BarryDE
Contributor
Contributor

BlockLevelVolumeCloneMgr::CloneVolume: Error: 37409 (type: 1, code: 2338)'

Hi all,

This ones got me a little stumped, hoping someone has some more experience.

Source windows 2012 64bit (fresh deployment, test server for newbies in team)

Converter version 6

ESX 5.5

I start conversion and fails at 3%~ with error.

BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code:2338)'

In worker logs all i can see is after the Worker InitialSyncFullCloneTask updates, state: 4, percentage: 3, xfer rate (Bps): 47285248 rows is as follows, no other errors - it just ends....

2015-11-08T02:16:48.945-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] TargetVmManagerImpl::DeleteVM

2015-11-08T02:16:48.945-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] Reusing existing VIM connection to 10.27.132.228

2015-11-08T02:16:48.976-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] Destroying vim.VirtualMachine:83 on 10.27.132.228

2015-11-08T02:16:49.241-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] WorkerConvertTask: Generating Agent Task bundle for task with id="task-1".

2015-11-08T02:17:26.916-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] WorkerConvertTask: Retrieving agent task log bundle to "C:\Windows\TEMP\vmware-temp\vmware-SYSTEM\agentTask-task-1-vzohlwml.zip".

2015-11-08T02:17:26.931-06:00 info vmware-converter-worker[07764] [Originator@6876 sub=task-7] WorkerConvertTask: Bundle successfully retrieved to "C:\Windows\TEMP\vmware-temp\vmware-SYSTEM\agentTask-task-1-vzohlwml.zip".

2015-11-08T02:17:26.931-06:00 error vmware-converter-worker[07764] [Originator@6876 sub=Default] Task failed:

The only clue i can give thus far is that i received an ADMIN$ error when connecting initially, resolved by changing "Turn on network discovery" to on.


There are no other errors in the worker log to give any clues, so far i have tried the following


EDIT: Checked the agent log, found the following.

Will review: VMware KB: Troubleshooting issues when vCenter Converter fails during conversion

Will review 2: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=201858...




2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNetTcpRead: bRead: -1

2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNet_Recv: requested 264, recevied only 0 bytes

2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcGetMessage: recv failed:

2015-11-08T02:16:48.250-06:00 warning vmware-converter-agent[06348] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcFssrvr_IO: failed to receive io reply

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06348] [Originator@6876 sub=Default] Sysimgbase_DiskLib_Write failed with 'NBD_ERR_NETWORK_CONNECT' (error code:2338)

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06348] [Originator@6876 sub=task-1] TargetVolumeWriter::WriteToVolume(): Error (type: 1, code: 2338) writing 655360 bytes to the destination volume at offset 0x0000000037894000

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06348] [Originator@6876 sub=task-1] Converter::BackgroundWriter::WriteToVolume: Write failed with error 37409.

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::QueueItem: CircularBuffer AddItem error, destroy workItem!

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06348] [Originator@6876 sub=task-1] BackgroundWriter::ThreadFunc: Broadcasting "ThreadDone" condition.

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06348] [Originator@6876 sub=ThreadPool] Thread delisted

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] BlockLevelVolumeCloneMgr::CloneVolume: failed with exception BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] ScopedBackgroundWriter::~ScopedBackgroundWriter: Error in ReleaseBackgroundWriter 37409.

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] [StreamCacheWriter] - TotalZeros : 0, TotalWrites : 1331

-->

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] SingleVolumeCloneTask:DoRun: Volume cloning failed with clone error BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

2015-11-08T02:16:48.250-06:00 error vmware-converter-agent[06048] [Originator@6876 sub=task-1] TaskImpl has failed with MethodFault::Exception: converter.fault.CloneFault

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] SingleVolumeCloneTask [source computer (unknown name)]-\WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00] --> [target VM (unknown name)]-3)=-;5;00000010000000000 updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] CompositeTask canceling #2 subtasks

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] TaskImpl issuing Cancel command

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] SingleVolumeCloneTask [source computer (unknown name)]-\WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00] --> [target VM (unknown name)]-3)=-;5;00000010000000000 updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] TaskImpl issuing Cancel command

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] SingleVolumeCloneTask [source computer (unknown name)]-\WindowsBitmapDriverVolumeId=[09-7B-3F-8E-00-00-10-00-00-00-00-00] --> [target VM (unknown name)]-90;7?3>(0000010000000000 updates, state: 0, percentage: 0, xfer rate (Bps): <unknown>

2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNetTcpWrite: bWritten: -1

2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcSendMessage: send failed: NFC_NETWORK_ERROR

2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcFssrvr_Close: failed to send close message

2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcNetTcpWrite: bWritten: -1

2015-11-08T02:16:48.750-06:00 warning vmware-converter-agent[04340] [Originator@6876 sub=Default] [,0] [NFC ERROR] NfcSendMessage: send failed: NFC_NETWORK_ERROR

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] VolumeBasedCloneTask source computer (unknown name) --> target VM (unknown name) updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] VolumeBasedCloneTask failed

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] CloneTask updates, state: 4, percentage: 3, xfer rate (Bps): 47286047

2015-11-08T02:16:48.750-06:00 info vmware-converter-agent[04340] [Originator@6876 sub=task-1] CloneTask failed

2015-11-08T02:16:48.750-06:00 error vmware-converter-agent[04340] [Originator@6876 sub=Default] Task failed:


Actions

  • Rerun job a couple more times - failed
  • Convert only C:\ - failed
  • Run Check disk /R on C:\ - failed


Points to consider.

  • Next step would be to install converter locally but i want to avoid this for now.
  • No workarounds to be deployed, i.e. use acronis - must be able to proceed with converter alone
  • Normally a checkdisk resolves this issue for me.


Question: What other things can cause the following error BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code:2338)'



Reply
0 Kudos
8 Replies
POCEH
VMware Employee
VMware Employee

Is this error consistently arrive? Seems like network drop which is interpreted as bad write and conversion terminates.

Please do not post logs - if you want to check them - simply attach them.

Reply
0 Kudos
dont_panic
Contributor
Contributor

hi there,

a little late, but same problem...   Smiley Wink

I found this, but haven´t try yet: http://www.vi-tips.com/2012/06/p2v-error-blocklevelvolumeclonemgr-and.html

any other solution meanwhile...?

Reply
0 Kudos
POCEH
VMware Employee
VMware Employee

There are many reasons for network error 2338, please attach log bundle for inspection.

Reply
0 Kudos
alessandroo
Contributor
Contributor

Hi,

Did you find the solution ?

I have the same issue...

Exactly the same error...

BlockLevelVolumeCloneMgr::CloneVolume: failed with exception BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[93-DD-5B-0B-00-00-10-00-00-00-00-00]. Error: 37409 (type: 1, code: 2338)

2015-11-08T02:16:48.250-06:00 info vmware-converter-agent[06048] [Originator@6876 sub=task-1] BackgroundWriter::~BackgroundWriter: Emptying CircularBuffer with abort conditions

Chkdsk /f /r done but same error....

Do i need a sfc /scannow??

Reply
0 Kudos
Cyres
Contributor
Contributor

Hello,

I had the same problem with the same error message.

The problem was the network connection. The card used was losing the connection to vCenter or ESX

So for me no problem of disk or service on the physical machine

Reply
0 Kudos
dirch201110141
Enthusiast
Enthusiast

Hi,

I got the same error as the original poster:

FAILED: An error occurred during the conversion: 'BlockLevelVolumeCloneMgr::CloneVolume: Detected a write error during the cloning of volume \WindowsBitmapDriverVolumeId=[48-BF-48-BF-00-7E-00-00-00-00-00-00]. Error: 37409 (type: 1, code:

2338)'

Source was a physical Windows 2003 SP2 on HP hardware.

Converter was 6.2.0 build 7448398.

Converter was run from jump server and not installed on source or vCenter.

It started out fine with a transferrate of 40-45 MB/second but failed after 2% or 3%.

None of these configurations worked:

- Chkdsk of drive C:

- Selected 1 disk at a time (I had Data Connections per Task set to 2)

- Selected just drive c: (that made it migrate to 36% before failure)

What worked was to select a different datastore as destination.

I reused the original setup with conversion of 2 drives in parallel but with another datastore. The datastores are theoretically alike .. .but ... but ... same same but diffferent. Transferrate was 8,75 Mb/second.

Reply
0 Kudos
POCEH
VMware Employee
VMware Employee

Write error is on destination side! Chkdsk and similar are executing and checking source side.

You'll need to check and repair datastore's disk(s).

HTH

Reply
0 Kudos
dirch201110141
Enthusiast
Enthusiast

True - I was not aware of the cause for a start, so I tried different things. I just listed what I went through.

There is something fishy with the datastore - no doubt - and 1000 chkdsk's in the world is not gonna change that.

Reply
0 Kudos