dbackup Tracker

FC SAN transport mode concurrent IO read failure

dbackup — Mon, 19 Jun 2023 02:27:58 GMT

Proxy agent：Ubuntu 16 and Ubuntu 20

VDDK version: VDDK 6.7、7.0、8.0

Reading ONE disk through SAN is successful, but reading multiple virtual machine disks simultaneously will fail (each virtual machine's disk is on the same LUN)

2023-06-08 15:39:30.173@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.160+08:00 error -[3701150] [Originator@6876 sub=Default] Incomplete read from, Wanted 1048576 Got 0, Error 2 (52)
2023-06-08 15:39:30.174@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.160+08:00 trivia -[3701150] [Originator@6876 sub=Default] Evaluating 1 paths.
2023-06-08 15:39:30.175@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.160+08:00 trivia -[3701150] [Originator@6876 sub=Default] Trying to open path /dev/sdc.
2023-06-08 15:39:30.176@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.174+08:00 info -[3701150] [Originator@6876 sub=Default] Now using Path /dev/sdc.
2023-06-08 15:39:30.177@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.176+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.177@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.176+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.178@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.176+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.179@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.177+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.179@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.177+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.180@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.177+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.181@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.179+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.181@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.179+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.182@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.179+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.183@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.181+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.184@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.181+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.184@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.181+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.186@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.183+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.187@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.183+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.188@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.183+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.188@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.184+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.189@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.184+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.190@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.184+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.191@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.186+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.192@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.186+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.192@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.186+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.193@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.191+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.194@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.192+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.194@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.192+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.195@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.193+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.196@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.193+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.197@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.193+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.197@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.196+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.200@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.196+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.201@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.197+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.201@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.198+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.202@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.199+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.203@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.199+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.203@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.201+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.204@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.201+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.206@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.201+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.207@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.206+08:00 error -[3701150] [Originator@6876 sub=Default] Incomplete read from, Wanted 1048576 Got 0, Error 2 (52)
2023-06-08 15:39:30.208@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.206+08:00 trivia -[3701150] [Originator@6876 sub=Default] Evaluating 1 paths.
2023-06-08 15:39:30.209@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.206+08:00 trivia -[3701150] [Originator@6876 sub=Default] Trying to open path /dev/sdc.
2023-06-08 15:39:30.210@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 info -[3701150] [Originator@6876 sub=Default] Path /dev/sdc seems to be inactive, ignoring.
2023-06-08 15:39:30.210@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 error -[3701150] [Originator@6876 sub=Default] No active paths found.
2023-06-08 15:39:30.211@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 error -[3701150] [Originator@6876 sub=BlockList]
2023-06-08 15:39:30.212@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.213@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 error -[3701150] [Originator@6876 sub=Default] San transport error: I/O Operation failed.
2023-06-08 15:39:30.214@infokist@3658437@LM_INFO@155|DISKLIB-LIB : RWv failed ioId: #723 (4096062) (62) .
2023-06-08 15:39:30.215@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread enlisted
2023-06-08 15:39:30.216@infokist@3658437@LM_INFO@155|2023-06-08T15:39:30.209+08:00 trivia -[3701150] [Originator@6876 sub=ThreadPool] Thread delisted
2023-06-08 15:39:30.217@infokist@3658437@LM_INFO@155|VixDiskLib: Detected DiskLib error 4096062 (One of the parameters supplied is invalid).
2023-06-08 15:39:30.218@infokist@3658437@LM_INFO@155|VixDiskLib: VixDiskLib_Read: Read 2048 sectors at 1478656 failed. Error 16000 (One of the parameters supplied is invalid) (DiskLib error 4096062: One of the parameters supplied is invalid) at 7867.
2023-06-08 15:39:30.219@infokist@3658437@LM_ERROR@155|Failed to read disk, VM=5235c7db-ae8b-ebb2-9733-1439edfd478b, vix_error=16000, err_msg=One of the parameters supplied is invalid
2023-06-08 15:39:30.220@infokist@3658437@LM_ERROR@155|Failed to read data from disk [san_test_lmy_2T] san_test-lmy-ubuntu1604/san_test-lmy-ubuntu1604.vmdk, offset 757071872, maxlen 1385694208

backup cause VM shutdown

dbackup — Tue, 25 Oct 2022 03:03:32 GMT

ESXi version: 6.7.0 build-8169922

VDDk:6.7

ESXi hostd.log:

Snapshot started

2022-10-19T12:00:14.341Z info hostd[2101180] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx opID=4b70d3e6-6d-1e1a user=vpxuser:BOCJS.BOCJS\Administrator] State Transition (VM_STATE_ON -> VM_STATE_CREATE_SNAPSHOT)

Snapshot success

2022-10-19T12:00:20.306Z info hostd[6851739] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] State Transition (VM_STATE_CREATE_SNAPSHOT -> VM_STATE_ON)

Get allocated blocks success

2022-10-19T12:00:24.433Z warning hostd[2101178] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx opID=6c9e69c7-9-1e49 user=vpxuser:BOCJS.BOCJS\Administrator] ChangeId '*' is deprecated, please call VixDiskLib_QueryAllocatedBlocks instead.

Then an error occurred, causing the VM to shutdown.

2022-10-19T12:01:45.766Z error hostd[2101178] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] Expected permission (3) for /vmfs/volumes/5f5f295f-0f15ad00-3bb1-80615f057c88/ISO not found in domain 9
2022-10-19T12:01:45.766Z info hostd[2101178] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] VM is in state VM_STATE_ON
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] SOCKET 3 (54)
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] recv detected client closed connection
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] VigorTransportClientProcessError: Remote disconnected
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] VigorTransportDrainRecv: draining read.
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] SOCKET 3 (54)
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] recv detected client closed connection
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] VigorTransportClientProcessError: closing connection.
2022-10-19T12:01:47.590Z info hostd[2100624] [Originator@6876 sub=Libs] VigorTransportClientManageConnection: connection closed; attempting to reconnect in case it is an FSR
2022-10-19T12:01:47.606Z info hostd[2100624] [Originator@6876 sub=Libs] CnxAuthdProtoSecureConnect: Unencrypted connection, skipping thumbprint exchange.
2022-10-19T12:01:47.610Z info hostd[2100624] [Originator@6876 sub=Libs] CnxConnectAuthd: Returning false because CnxAuthdProtoConnect failed
2022-10-19T12:01:47.610Z info hostd[2100624] [Originator@6876 sub=Libs] Cnx_Connect: Returning false because CnxConnectAuthd failed
2022-10-19T12:01:47.610Z info hostd[2100624] [Originator@6876 sub=vm] Cnx_Connect: Error message: There is no VMware process running for config file /vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx
2022-10-19T12:01:47.610Z info hostd[2100624] [Originator@6876 sub=vm] VigorTransportClientManageConnection: VM /vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx does not appear to be running
2022-10-19T12:01:47.612Z info hostd[6851739] [Originator@6876 sub=Libs] VigorOnlineDisconnectCb: connection closed (is final).
2022-10-19T12:01:47.621Z error hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] Expected permission (3) for /vmfs/volumes/5f5f295f-0f15ad00-3bb1-80615f057c88/ISO not found in domain 9
2022-10-19T12:01:47.621Z info hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] VM is in state VM_STATE_ON
2022-10-19T12:01:47.621Z info hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] State Transition (VM_STATE_ON -> VM_STATE_OFF)
2022-10-19T12:01:47.622Z info hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] Marking VirtualMachine invalid
2022-10-19T12:01:47.622Z warning hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] Failed to find activation record, event user unknown.
2022-10-19T12:01:47.622Z info hostd[2101179] [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 106696 : Issue detected for HeZhanGuo-DaiLiQianZhiYeWu-30-5-10 on yhw1-d in ha-datacenter: Configuration file has unexpected changes. Virtual machine has been terminated. Unregister and re-register virtual machine if the configuration file is correct.
2022-10-19T12:01:47.622Z info hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] State Transition (VM_STATE_OFF -> VM_STATE_COMPROMISED)
2022-10-19T12:01:47.678Z warning hostd[2101179] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5f5f292c-2aa5603e-d599-80615f057c88/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10/HeZhanGuo-DaiLiQianZhiYeWu-30-5-10.vmx] Failed to find activation record, event user unknown.
2022-10-19T12:01:47.678Z info hostd[2101179] [Originator@6876 sub=Vimsvc.ha-eventmgr] Event 106697 : HeZhanGuo-DaiLiQianZhiYeWu-30-5-10 on  yhw1-d in ha-datacenter is powered off

What’s the reason and what should I do?

VDDK 7.0.3 print VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code

dbackup — Fri, 08 Apr 2022 07:05:00 GMT

I used NBD mode to read VM disk, and it printed a pile of this stuff. What does that mean and how do I remove it ? Although it does not seem to affect reading VM disk.

2022-04-08 14:49:26.656@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushConfigData : Failed to push vendor product data at line 2044.
2022-04-08 14:49:26.869@ubuntu1604@6872@LM_INFO@.7002|VDDK_PhoneHome: VddkVacWriteLastMember : Empty field to serialize for key fail_function at line 266.
2022-04-08 14:49:27.084@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:27.294@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:27.295@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:27.295@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushData : Failed to post data to VC/PH at line 1706.
2022-04-08 14:49:27.576@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushBackupData : Failed to push backup data at line 2893.
2022-04-08 14:49:27.787@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:28.001@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:28.001@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:28.001@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushData : Failed to post data to VC/PH at line 1706.
2022-04-08 14:49:28.006@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushEnvironmentData : Failed to push env data at line 1807.
2022-04-08 14:49:28.219@ubuntu1604@6872@LM_INFO@.7002|VDDK_PhoneHome: VddkVacWriteMember : Empty field to serialize for key edition at line 217.
2022-04-08 14:49:28.430@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:28.640@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:28.641@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:28.642@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushData : Failed to post data to VC/PH at line 1706.
2022-04-08 14:49:28.854@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushProductInstanceData : Failed to push product instance data at line 1885.
2022-04-08 14:49:29.068@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:29.279@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:29.279@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: Curl perform failed in VddkVacHttpsPost with error code 77 at 92.
2022-04-08 14:49:29.280@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushData : Failed to post data to VC/PH at line 1706.
2022-04-08 14:49:29.360@ubuntu1604@6872@LM_WARNING@.7002|VDDK_PhoneHome: VddkVacPushVendorProductData : Failed to push vendor product data at line 2181.
2022-04-08 14:49:29.481@ubuntu1604@6872@LM_INFO@.7002|Signal 15 (Terminated) catched in [starter].

Re: Cannot open disk with mode independent persistent

dbackup — Tue, 14 Mar 2023 03:50:02 GMT

I have the same situation

Re: How to backup VM with two delta file through VDDK

dbackup — Tue, 23 Nov 2021 08:04:37 GMT

Yes, snapshot MoRef is needed to open quiesced snapshot file in some circumstances, like double snapshot files.

Re: How to backup VM with two delta file through VDDK

dbackup — Mon, 22 Nov 2021 07:10:13 GMT

It turns out that i forgot to set up snapshotRef in VixDiskLib_ConnectEx, problem solved.

How to backup VM with two delta file through VDDK

dbackup — Fri, 19 Nov 2021 08:40:02 GMT

Hello, I have a Virtual Machine on ESXi 7.0:

Guest OS: Microsoft Windows Server 2016 (64-bit)
Compatibility: VmHardware.HWVersion.long.vmx-19
VMware Tools: Running, version:11333 (Current)

It has only one disk on SCSI controller 0:

Type: Thick Provision Lazy Zeroed
Disk File: [d2] 2016/2016.vmdk
Disk Mode: Dependent

quiesced snapshot part

After creating a quiesced snapshot, I found that it had two delta files(aka child disks) which is strange because only one delta file should be generated:

vCenter shows that the virtual machine is now using [d2] 2016/2016-000001.vmdk:

And Managed Object Browser shows that the disk recorded in the snapshot is [d2] 2016/2016-000002.vmdk

Obviously I can't open them READ ONLY through VDDK 7.0.3, NBD transport mode:

KLog: NBD_ClientOpen: attempting to create connection to vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902
KLog: Setting NFC log level to 1
KLog: Setting NFC log level to 1
KLog: NFC Async IO session is established for '[d2] 2016/2016-000001.vmdk' with log level 1.
KLog: Opening file [d2] 2016/2016-000001.vmdk (vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902)
KWarning: [NFC ERROR]NfcAioRcvErrorMsg: Error from server: NfcAioProcessOpenFileMsg: Failed to open '[d2] 2016/2016-000001.vmdk': DiskLib error 49: Thin/TBZ/Sparse disks cannot be opened in multiwriter mode
KLog: Fail to open file [d2] 2016/2016-000001.vmdk
KLog: DISKLIB-DSCPTR: : "vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902" : Failed to open NBD extent.
KLog: DISKLIB-LINK : "vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902" : failed to open (Thin/TBZ/Sparse disks cannot be opened in multiwriter mode).
KLog: DISKLIB-CHAIN : "vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902" : failed to open (Thin/TBZ/Sparse disks cannot be opened in multiwriter mode).
KLog: DISKLIB-LIB : Failed to open 'vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902' with flags 0xe Thin/TBZ/Sparse disks cannot be opened in multiwriter mode (49).
KLog: VixDiskLib: Detected DiskLib error 49 (Thin/TBZ/Sparse disks cannot be opened in multiwriter mode).
KLog: VixDiskLib: Failed to open disk vpxa-nfc://[d2] 2016/2016-000001.vmdk@192.168.88.230:902!52 26 a2 59 d8 1d 32 3e-af 4e c9 d9 18 f1 5e b5. Error 1 (Unknown error) (DiskLib error 49: Thin/TBZ/Sparse disks cannot be opened in multiwriter mode) at 6469.
KLog: VixDiskLib: VixDiskLib_OpenEx: Cannot open disk [d2] 2016/2016-000001.vmdk. Error 1 (Unknown error) (DiskLib error 49: Thin/TBZ/Sparse disks cannot be opened in multiwriter mode) at 7133.
KLog: VixDiskLib: VixDiskLib_Open: Cannot open disk [d2] 2016/2016-000001.vmdk. Error 1 (Unknown error) at 7211.
Failed to open

KLog: VixDiskLib: VixDiskLib_OpenEx: Open a disk.
KLog: 2021-11-19T16:19:01.733+08:00 error -[05958] [Originator@6876 sub=vimaccess] GetFileName: Cannot create disk spec for disk [d2] 2016/2016-000002.vmdk.
KLog: -->
KLog: VixDiskLib: Error occurred when obtaining the file name for [d2] 2016/2016-000002.vmdk. Error 1 (Unknown error) (Cannot create disk spec for disk.) at 3344.
KLog: VixDiskLib: VixDiskLib_OpenEx: Cannot open disk [d2] 2016/2016-000002.vmdk. Error 1 (Unknown error) at 7133.
KLog: VixDiskLib: VixDiskLib_Open: Cannot open disk [d2] 2016/2016-000002.vmdk. Error 1 (Unknown error) at 7211.
Failed to open

But I CAN open [d2] 2016/2016.vmdk to read, so I backup the whole [d2] 2016/2016.vmdk disk(not just allocated blocks) through VDDK.

Finally, I restored the disk to the virtual machine. And try to use it to start the virtual machine, but the blue screen is directly displayed when starting:

none quiesced snapshot part

So I created a none quiesced snapshot instead. And it has only ONE delta file as expected.

I backup [d2] 2016/2016.vmdk through VDDK 7.0.3 and restore to the virtual machine again. And the operating system can be turned on normally this time.

question

How do I back up this virtual machine with a quiesced snapshot?