VDP 5.1.11 Error code: 30915

[dunc01]

Using VDP to backup Windows 2008 R2 server - upgraded to 5.1.11 to fix the quiesced snapshot issue.

Some VMs are now backing up, but random others are getting this message:

Error code 30915: An attempt was made to backup a client in a group failed because the client does not have any data matching the data target specified in the dataset.

Google searches are proving fruitless....  any clues?

[john23]

can you provide detailed logs...

[dunc01]

Log file......

2013-12-03 00:06:38 avvcbimage Info : Logging to /usr/local/avamarclient/var-proxy-3/Daily Backup-1386029180669-bdc3a47ebb154cc3958af34de884bad564c36ec2-3016-vmimagew.log 2013-12-03 00:06:38 avvcbimage Info : - Reading /root/.avamar

2013-12-03 00:06:38 avvcbimage Info : - Reading /usr/local/avamar/etc/usersettings.cfg

2013-12-03 00:06:38 avvcbimage Info : - Reading /usr/local/avamarclient/var-proxy-3/avvcbimage.cmd

2013-12-03 00:06:38 avvcbimage Info : - Reading /usr/local/avamarclient/var/avvcbimageAll.cmd

2013-12-03 00:06:38 avvcbimage Info : CTL listening on port 58088

2013-12-03 00:06:38 avvcbimage Info : Setting ctl message version to 3 (from 1)

2013-12-03 00:06:38 avvcbimage Info : Setting ctl max message size to 268435456

2013-12-03 00:06:38 avvcbimage Info : Login test is OK.

2013-12-03 00:06:38 avvcbimage Info : VM Info: VMX version 4(F), ctk enabled(T), fault tolerant (F), Guest OS Microsoft Windows Server 2008 R2 (64-bit), Cloud UUID = NoUUID.

2013-12-03 00:06:38 avvcbimage Info : WorkOrder Disk Info:  Disk '2000': file(base):'[CW-SAN-VOL2] CW-DC/CW-DC.vmdk', backItUp=1

                snapshot file:'[CW-SAN-VOL2] CW-DC/CW-DC-000001.vmdk'

                prior size(KB):0, current size(KB):41943040, match=0

                change block ID:''

2013-12-03 00:06:38 avvcbimage Info : proxy VM DNS name is: 127.0.0.2,cw-vdp.fqdn,cw-vdp,x.x.x.x

2013-12-03 00:06:38 avvcbimage Info : vCenter 'XXX' is cw-vcentre.fqdn

2013-12-03 00:06:38 avvcbimage Info : VM's host is x.x.x.x

2013-12-03 00:06:38 avvcbimage Info : VM's primary storage location is [CW-SAN-VOL2] CW-DC/CW-DC.vmx

2013-12-03 00:06:38 avvcbimage Info : VM's vCenter ID is vm-44

2013-12-03 00:06:38 avvcbimage Info : VM's backup account on cw-vdp.fqdn is /cw-vcentre.fqdn/VirtualMachines/CW-DC_UBcfFWKZryLrCNcV7cHPWQ

2013-12-03 00:06:38 avvcbimage Info : Changed block tracking is engaged for this VM

2013-12-03 00:06:38 avvcbimage Info : A reference to a valid prior backup is not available so this will be a full level zero backup.

2013-12-03 00:06:38 avvcbimage Info : Login test is OK.

2013-12-03 00:06:38 avvcbimage Info : - Reading /usr/local/avamarclient/var-proxy-3/avvcbimage.cmd

2013-12-03 00:06:38 avvcbimage Info : - Reading /usr/local/avamarclient/var/avvcbimageAll.cmd

2013-12-03 00:06:38 avvcbimage Info : target[0]=[CW-SAN-VOL2] CW-DC/CW-DC.vmdk

2013-12-03 00:06:38 avvcbimage Info : VDDK:VixDiskLib: linuxVerifySSLCertificates is 0

2013-12-03 00:06:38 avvcbimage Info : VDDK:VixDiskLib: config options: libdir '/usr/lib/vmware-vix-disklib', tmpDir '/usr/local/avamarclient/var-proxy-3/vmware/temp'.

2013-12-03 00:06:38 avvcbimage Info : VDDK:OBJLIB-LIB : Objlib initialized.

2013-12-03 00:06:38 avvcbimage Info : VDDK:VixDiskLib: Attempting to locate advanced transport module in "/usr/lib/vmware-vix-disklib".

2013-12-03 00:06:41 avvcbimage Info : VDDK:VixDiskLib: Advanced transport plugin was successfully loaded into vixDiskLib.

2013-12-03 00:06:41 avvcbimage Info : VDDK:VixDiskLib: Enabling advanced transport modes.

2013-12-03 00:06:41 avvcbimage Info : VDDK:OBJLIB-LIB : Objlib initialized.

2013-12-03 00:06:41 avvcbimage Info : VDDK:VixDiskLib: Transport modes available: file:nbdssl:nbd:san.

2013-12-03 00:06:41 avvcbimage Info : VDDK:VMware VixDiskLib (5.1) Release build-1042608

2013-12-03 00:06:41 avvcbimage Info : Available transport modes are file:san:hotadd:nbdssl:nbd

2013-12-03 00:06:41 avvcbimage Info : VDDK:VixDiskLibVimResolveHostName: Resolving IP address for hostname cw-vcentre.fqdn:443.

2013-12-03 00:06:41 avvcbimage Info : VDDK:VixDiskLibVimResolveHostName: Resolved to x.x.x.x

2013-12-03 00:06:41 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLogin

2013-12-03 00:06:43 avvcbimage Info : VDDK:VixDiskLibVim: TicketFindVMByMoRef: vmxPath = -vm-44-

2013-12-03 00:06:43 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLoadVM

2013-12-03 00:06:43 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLoadAuthMgr

2013-12-03 00:06:43 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLoadVMCb

2013-12-03 00:06:44 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLogout

2013-12-03 00:06:44 avvcbimage Info : VixDiskLib vMotion reservation successfully enabled by 'vSphere Data Protection'

2013-12-03 00:06:44 avvcbimage Info : Running cleanup of old backups.

2013-12-03 00:06:44 avvcbimage Info : VixDiskLib_Cleanup() found no prior mounts to cleanup.

2013-12-03 00:06:44 avvcbimage Info : Login test is OK.

2013-12-03 00:07:56 avvcbimage Warning : Soap fault detected, Snapshot remove problem, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Error observed by underlying BIO: Connection reset by peer" Detail: SSL_connect error in tcp_connect() '

2013-12-03 00:07:56 avvcbimage Info : The VM '[CW-SAN-VOL2] CW-DC/CW-DC.vmx' has no old snapshots to delete.

2013-12-03 00:07:56 avvcbimage Warning : Soap fault detected, Problem retrieving Snapshot, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Connection refused" Detail: connect failed in tcp_connect() '

2013-12-03 00:07:56 avvcbimage Info : no snapshots are present on this VM.

2013-12-03 00:07:56 avvcbimage Info : Logging into datacenter path of 'folder?dcPath=XXX'

2013-12-03 00:07:56 avvcbimage Warning : HTTP fault detected, Problem connecting to HTTP, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Connection refused" Detail: connect failed in tcp_connect() '

2013-12-03 00:07:56 avvcbimage Warning : Download DataStore info retry, count=0.

2013-12-03 00:08:01 avvcbimage Info : Logging into datacenter path of 'folder?dcPath=XXX'

2013-12-03 00:08:01 avvcbimage Warning : HTTP fault detected, Problem connecting to HTTP, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Connection refused" Detail: connect failed in tcp_connect() '

2013-12-03 00:08:01 avvcbimage Warning : Download DataStore info retry, count=1.

2013-12-03 00:08:06 avvcbimage Info : Logging into datacenter path of 'folder?dcPath=XXX'

2013-12-03 00:08:06 avvcbimage Warning : HTTP fault detected, Problem connecting to HTTP, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Connection refused" Detail: connect failed in tcp_connect() '

2013-12-03 00:08:06 avvcbimage Warning : Download DataStore info retry, count=2.

2013-12-03 00:08:11 avvcbimage Warning : Max retries for DataStore/File Metadata info, count=3.

2013-12-03 00:08:11 avvcbimage Warning : The datastore from VMX '[CW-SAN-VOL2] CW-DC/CW-DC.vmx' could not be fully inspected.

2013-12-03 00:08:11 avvcbimage Info : a VM snapshot has been requested

2013-12-03 00:08:11 avvcbimage Info : Creating snapshot 'VDP-1386029291bdc3a47ebb154cc3958af34de884bad564c36ec2', quieceFS=1

2013-12-03 00:08:11 avvcbimage Warning : Soap fault detected, Snapshot task - NOT ok, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Connection refused" Detail: connect failed in tcp_connect() '

2013-12-03 00:08:11 avvcbimage Info : Creating snapshot 'VDP-1386029291bdc3a47ebb154cc3958af34de884bad564c36ec2', quieceFS=0

2013-12-03 00:08:11 avvcbimage Warning : Soap fault detected, Snapshot task - NOT ok, Msg:'SOAP 1.1 fault: SOAP-ENV:Client [no subcode] "Connection refused" Detail: connect failed in tcp_connect() '

2013-12-03 00:08:11 avvcbimage FATAL : The VMX '[CW-SAN-VOL2] CW-DC/CW-DC.vmx' could not be snapshot.

2013-12-03 00:08:11 avvcbimage Info : Starting graceful (staged) termination, Create Snapshot failure. (wrap-up stage)

2013-12-03 00:08:11 avvcbimage Error : createSnapshot: snapshot creation failed

2013-12-03 00:08:11 avvcbimage Info : snapshot created:false NOMC:false ChangeBlTrackingAvail:true UsingChBl:true, FullBackup=true

2013-12-03 00:08:11 avvcbimage Info : Available transport modes are file:san:hotadd:nbdssl:nbd

2013-12-03 00:08:11 avvcbimage Info : Calling ConnectEx with servername=cw-vcentre.fqdn:443 vmxspec=moref=vm-44 on port 0 snapshot()

2013-12-03 00:08:11 avvcbimage Info : virtual machine will be connected readonly

2013-12-03 00:08:11 avvcbimage Info : VixDiskLib_ConnectEx returned VIX_OK

2013-12-03 00:08:11 avvcbimage Info : Disconnected from VM

2013-12-03 00:08:11 avvcbimage Info : VDDK:VixDiskLibVimResolveHostName: Resolving IP address for hostname cw-vcentre.fqdn:443.

2013-12-03 00:08:11 avvcbimage Info : VDDK:VixDiskLibVimResolveHostName: Resolved to x.x.x.x

2013-12-03 00:08:11 avvcbimage Info : Final summary, cancelled/aborted 0, snapview 1, exitcode 202: plugin error 02

2013-12-03 00:08:11 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLogin

2013-12-03 00:08:11 avvcbimage Warning : VDDK:VixDiskLibVim: Login failure - VixError = 0.

2013-12-03 00:08:11 avvcbimage Info : VDDK:VixDiskLibVim: VixDiskLibVimLogout

2013-12-03 00:08:11 avvcbimage Warning : VixDiskLib vMotion reservation release returned fault(18000) (18000) Cannot connect to the host - host:cw-vcentre.fqdn:443 account:xxx\vmware dc:/XXX44

--------------------------------------------------------------------------------------------------------

----- END avvcbimage log 2013-12-03 00:08:16 GMT  (14 warnings, 2 errors, 1 fatal error)

--------------------------------------------------------------------------------------------------------

[john23]

From the logs:

Creating snapshot 'VDP-1386029291bdc3a47ebb154cc3958af34de884bad564c36ec2', quieceFS=1

2013-12-03 00:08:11 avvcbimage Info : Creating snapshot 'VDP-1386029291bdc3a47ebb154cc3958af34de884bad564c36ec2', quieceFS=0

2013-12-03 00:08:11 avvcbimage Info : Starting graceful (staged) termination, Create Snapshot failure. (wrap-up stage)

2013-12-03 00:08:11 avvcbimage Error : createSnapshot: snapshot creation failed

Are you able to take the snapshot of the vm manually with quiece enabled??

[dunc01]

John,

yes, just completed a snapshot for this server - no problems at all...