VMware Global Community
Tomas_D_8
Contributor
Contributor

Problem with vSphere Data Protection

VDP has ceased to perform the backup.
The task starts, the snapshot starts and so much


logs can give more information

What an interesting only one machine backup is ok

sorry for my English


015-10-07 21:09:51 avagent Info <5964>: Requesting work from 127.0.0.1

2015-10-07 21:09:52 avagent Warning <15187>: message needs ack, but received null response queue!

2015-10-07 21:09:52 avagent Info <6686>: Process 21421 (/usr/local/avamarclient/bin/avvcbimage) for workorder manual-test-1444244980542 started

2015-10-07 21:09:53 avagent Info <10684>: Setting ctl message version to 3 (from 1)

2015-10-07 21:09:53 avagent Info <16136>: Setting ctl max message size to 268435456

2015-10-07 21:10:02 avagent Info <5964>: Requesting work from 127.0.0.1

2015-10-07 21:10:02 avagent Info <5264>: Workorder received: sleep

2015-10-07 21:10:02 avagent Info <5996>: Sleeping 15 seconds

2015-10-07 21:10:02 avagent Info <6688>: Process 21421 (/usr/local/avamarclient/bin/avvcbimage) finished (code 134: Unknown error 134)

2015-10-07 21:10:02 avagent Warning <6690>: CTL workorder "manual-test-1444244980542" non-zero exit status 'code 134: Unknown error 134'

2015-10-07 21:10:02 avagent Error <6614>: CTL: Unable to find filesystem plugin for progress report

2015-10-07 21:10:02 avagent Warning <14837>: Unable to get pid of progress avtar while processing stop

--------------------------------------------------------------------------------------------------------------------------------------------------------

2015-10-06 22:00:00 avagent Info <5964>: Requesting work from 127.0.0.1

2015-10-06 22:00:02 avagent Warning <15187>: message needs ack, but received null response queue!

2015-10-06 22:00:02 avagent Info <6686>: Process 29061 (/usr/local/avamarclient/bin/avvcbimage) for workorder LINUX-LINUX-1444161600216 started

2015-10-06 22:00:03 avagent Info <10684>: Setting ctl message version to 3 (from 1)

2015-10-06 22:00:03 avagent Info <16136>: Setting ctl max message size to 268435456

2015-10-06 22:06:18 avagent Info <6688>: Process 29061 (/usr/local/avamarclient/bin/avvcbimage) finished (code 134: Unknown error 134)

2015-10-06 22:06:18 avagent Warning <6690>: CTL workorder "LINUX-LINUX-1444161600216" non-zero exit status 'code 134: Unknown error 134'

2015-10-06 22:06:18 avagent Error <6614>: CTL: Unable to find filesystem plugin for progress report

2015-10-06 22:06:18 avagent Warning <14837>: Unable to get pid of progress avtar while processing stop

------------------------------------------------------------------------------------------------------------------------------------------------------------

<logheader platform="Linux" process_id="avvcbimage" version="6.1.180-179" tz="CEST" />

--------------------------------------------------------------------------------------------------------

-----  START avvcbimage log 2015-09-29 12:38:32 CEST  [6.1.180-179 Linux-x86_64]

--------------------------------------------------------------------------------------------------------

2015-09-29 12:38:32 avvcbimage Info <5008>: Logging to /usr/local/avamarclient/var-proxy-2/E-LINUX-1443523109368-60b040bb993b7031955bb04e7f28f72936cad464-1016-vmimagel.log

2015-09-29 12:38:32 avvcbimage Info <5174>: - Reading /root/.avamar

2015-09-29 12:38:32 avvcbimage Info <5174>: - Reading /usr/local/avamar/etc/usersettings.cfg

2015-09-29 12:38:32 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var-proxy-2/avvcbimage.cmd

2015-09-29 12:38:32 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var/avvcbimageAll.cmd

2015-09-29 12:38:32 avvcbimage Info <6673>: CTL listening on port 53336

2015-09-29 12:38:32 avvcbimage Info <10684>: Setting ctl message version to 3 (from 1)

2015-09-29 12:38:32 avvcbimage Info <16136>: Setting ctl max message size to 268435456

2015-09-29 12:38:32 avvcbimage Info <14625>: WorkOrder Disk Info:

  Disk '2000': file(base):'[DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk', backItUp=1

               snapshot file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL-000001.vmdk'

               prior size(KB):20971520, current size(KB):20971520, match=1

               change block ID:'52 41 f2 f9 33 b8 d9 98-53 34 94 bb 1d f9 60 3b/1569'

  Disk '2001': file(base):'[DS01_R6_G01_L05] E-MAIL/E-MAIL_1.vmdk', backItUp=1

               snapshot file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL_1-000001.vmdk'

               prior size(KB):20971520, current size(KB):20971520, match=1

               change block ID:'52 5a 68 27 d1 26 96 eb-e6 60 94 1c c0 2c 7d 1b/1793'

  Disk '2002': file(base):'[DS01_R6_G01_L05] E-MAIL/E-MAIL_2.vmdk', backItUp=1

               snapshot file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL_2-000001.vmdk'

               prior size(KB):20971520, current size(KB):20971520, match=1

               change block ID:'52 d9 d7 39 d0 42 43 1d-e2 67 1a 3c 74 c8 2b 8a/1569'

2015-09-29 12:38:32 avvcbimage Info <11979>: proxy VM DNS name is: 127.0.0.2,E-vdp02.E.loc,E-vdp02,192.168.2.199

2015-09-29 12:38:32 avvcbimage Info <16010>: vCenter 'E S.A.' is E-vcsa01.E.loc

2015-09-29 12:38:32 avvcbimage Info <11981>: VM's host is esx02srv

2015-09-29 12:38:32 avvcbimage Info <11982>: VM's primary storage location is [DS01_R6_G01_L05] E-MAIL/E-MAIL.vmx

2015-09-29 12:38:32 avvcbimage Info <11983>: VM's vCenter ID is vm-26

2015-09-29 12:38:32 avvcbimage Info <11984>: VM's backup account on E-vdp02.E.loc is /E-vcsa01.E.loc/VirtualMachines/E-MAIL_UAwy9NYgCITZ17triFhHqw

2015-09-29 12:38:32 avvcbimage Info <11986>: Changed block tracking is engaged for this VM

2015-09-29 12:38:32 avvcbimage Info <11987>: Reference backup is #829 captured on unknown date

2015-09-29 12:38:32 avvcbimage Info <14680>: A reference to a valid prior backup is available so this will be an incremental.

2015-09-29 12:38:32 avvcbimage Info <14692>: Login test is OK.

2015-09-29 12:38:32 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var-proxy-2/avvcbimage.cmd

2015-09-29 12:38:32 avvcbimage Info <5174>: - Reading /usr/local/avamarclient/var/avvcbimageAll.cmd

2015-09-29 12:38:32 avvcbimage Info <7084>: target[0]=[DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk

2015-09-29 12:38:32 avvcbimage Info <7084>: target[1]=[DS01_R6_G01_L05] E-MAIL/E-MAIL_1.vmdk

2015-09-29 12:38:32 avvcbimage Info <7084>: target[2]=[DS01_R6_G01_L05] E-MAIL/E-MAIL_2.vmdk

2015-09-29 12:38:32 avvcbimage Info <16041>: VDDK:VixDiskLib: linuxVerifySSLCertificates is 0

2015-09-29 12:38:32 avvcbimage Info <16041>: VDDK:VixDiskLib: config options: libdir '/usr/lib/vmware-vix-disklib', tmpDir '/usr/local/avamarclient/var-proxy-2/vmware/temp'.

2015-09-29 12:38:32 avvcbimage Info <16041>: VDDK:OBJLIB-LIB : Objlib initialized.

2015-09-29 12:38:32 avvcbimage Info <16041>: VDDK:VixDiskLib: Attempting to locate advanced transport module in "/usr/lib/vmware-vix-disklib".

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLib: Advanced transport plugin was successfully loaded into vixDiskLib.

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLib: Enabling advanced transport modes.

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:OBJLIB-LIB : Objlib initialized.

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLib: Transport modes available: file:nbdssl:nbd:san.

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VMware VixDiskLib (5.1) Release build-774844

2015-09-29 12:38:33 avvcbimage Info <9666>: Available transport modes are file:san:hotadd:nbdssl:nbd

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVimResolveHostName: Resolving IP address for hostname E-vcsa01.E.loc:443.

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVimResolveHostName: Resolved to 192.168.2.191.

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLogin

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVim: TicketFindVMByMoRef: vmxPath = -vm-26-

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLoadVM

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLoadAuthMgr

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLoadVMCb

2015-09-29 12:38:33 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLogout

2015-09-29 12:38:33 avvcbimage Info <16042>: VixDiskLib_PrepareForAccess returned VIX_OK, name='vSphere Data Protection'

2015-09-29 12:38:33 avvcbimage Info <16011>: Running cleanup of old backups.

2015-09-29 12:38:34 avvcbimage Info <9671>: VixDiskLib_Cleanup() cleaned up  1 VMs with 0 remaining

2015-09-29 12:38:34 avvcbimage Info <14692>: Login test is OK.

2015-09-29 12:38:34 avvcbimage Info <14679>: Removing prior snapshot[0], 'VDP-144347051960b040bb993b7031955bb04e7f28f72936cad464'.

2015-09-29 12:40:01 avvcbimage Info <14664>: no snapshots are present on this VM.

2015-09-29 12:40:01 avvcbimage Info <15994>: Logging into datacenter path of 'folder?dcPath=E%20S%2EA%2E'

2015-09-29 12:40:02 avvcbimage Info <14673>: All Datastore Info:

  datastore:'DS01_R5_G02_L01               '  capacity=2998960914432   free=249108103168

  datastore:'DS01_R6_G01_L00               '  capacity=44828721152     free=2259681280

  datastore:'DS01_R6_G01_L01               '  capacity=1099243192320   free=705171554304

  datastore:'DS01_R6_G01_L02               '  capacity=2198754820096   free=200516042752

  datastore:'DS01_R6_G01_L03               '  capacity=3298266447872   free=64227377152

  datastore:'DS01_R6_G01_L05               '  capacity=549487378432    free=120313610240

  datastore:'iscsi_infortrend              '  capacity=19992267456512  free=2502863880192

2015-09-29 12:40:02 avvcbimage Info <14675>: All VM Info (16/16):

  VM:'E-CDNXL/                             '  last modified on '29-Sep-2015 09:58'

  VM:'E-DNS/                               '  last modified on '29-Sep-2015 10:39'

  VM:'E-MADAR/                             '  last modified on '29-Sep-2015 10:39'

  VM:'E-MAIL/                              '  last modified on '29-Sep-2015 10:40'

  VM:'E-PROXY/                             '  last modified on '29-Sep-2015 10:40'

  VM:'E-VCSA01/                            '  last modified on '29-Sep-2015 10:39'

  VM:'E-VMA/                               '  last modified on '29-Sep-2015 10:38'

  VM:'E-WWW/                               '  last modified on '29-Sep-2015 10:40'

  VM:'EDB01/                               '  last modified on '26-Sep-2015 10:23'

  VM:'EDC01/                               '  last modified on '11-Sep-2015 10:52'

  VM:'EFTP/                                '  last modified on '12-Sep-2015 07:24'

  VM:'geo-licsrv_p*/            '  last modified on '28-Sep-2015 20:27'

2015-09-29 12:40:02 avvcbimage Info <14677>: All VM file Info:

  File:'E-MAIL-8b18c42b.hlog                           ' last modified on '24-Sep-2015 08:31'  size=73

  File:'E-MAIL-8b18c42b.vswp                           ' last modified on '08-Sep-2015 11:12'  size=4294967296

  File:'E-MAIL-aux.xml                                 ' last modified on '07-Dec-2012 07:32'  size=13

  File:'E-MAIL-ctk.vmdk                                ' last modified on '29-Sep-2015 10:40'  size=1311232

  File:'E-MAIL-flat.vmdk                               ' last modified on '29-Sep-2015 10:40'  size=21474836480

  File:'E-MAIL.nvram                                   ' last modified on '29-Sep-2015 10:40'  size=8684

  File:'E-MAIL.vmdk                                    ' last modified on '29-Sep-2015 10:40'  size=606

  File:'E-MAIL.vmsd                                    ' last modified on '29-Sep-2015 10:40'  size=46

  File:'E-MAIL.vmx                                     ' last modified on '29-Sep-2015 10:40'  size=3303

  File:'E-MAIL.vmx.lck                                 ' last modified on '24-Sep-2015 08:32'  size=0

  File:'E-MAIL.vmxf                                    ' last modified on '10-Sep-2015 08:43'  size=3326

  File:'E-MAIL.vmx~                                    ' last modified on '29-Sep-2015 10:40'  size=3310

  File:'E-MAIL_1-ctk.vmdk                              ' last modified on '29-Sep-2015 10:40'  size=1311232

  File:'E-MAIL_1-flat.vmdk                             ' last modified on '29-Sep-2015 10:40'  size=21474836480

  File:'E-MAIL_1.vmdk                                  ' last modified on '29-Sep-2015 10:40'  size=610

  File:'E-MAIL_2-ctk.vmdk                              ' last modified on '29-Sep-2015 10:40'  size=1311232

  File:'E-MAIL_2-flat.vmdk                             ' last modified on '22-Sep-2015 13:14'  size=21474836480

  File:'E-MAIL_2.vmdk                                  ' last modified on '29-Sep-2015 10:40'  size=584

  File:'vmware-21.log                                     ' last modified on '14-Nov-2014 06:55'  size=30524726

  File:'vmware-22.log                                     ' last modified on '07-Sep-2015 21:38'  size=34935909

  File:'vmware-23.log                                     ' last modified on '10-Sep-2015 06:12'  size=177177

  File:'vmware-24.log                                     ' last modified on '10-Sep-2015 08:43'  size=207216

  File:'vmware-25.log                                     ' last modified on '23-Sep-2015 07:24'  size=401361

  File:'vmware-26.log                                     ' last modified on '24-Sep-2015 08:31'  size=206783

  File:'vmware.log                                        ' last modified on '29-Sep-2015 10:40'  size=456977

  File:'vmx-E-MAIL-2333656107-2.vswp                   ' last modified on '10-Sep-2015 08:43'  size=96468992

2015-09-29 12:40:02 avvcbimage Info <16001>: Found 3 disk(s), 0 snapshots, and 0 snapshot ctk files, on the VMs datastore.

2015-09-29 12:40:02 avvcbimage Info <9692>: a VM snapshot has been requested

2015-09-29 12:40:02 avvcbimage Info <14627>: Creating snapshot 'VDP-144352320260b040bb993b7031955bb04e7f28f72936cad464', quieceFS=1

2015-09-29 12:40:02 avvcbimage Info <14631>: create snapshot task still in progress, sleep for 2 sec.

2015-09-29 12:40:04 avvcbimage Info <14631>: create snapshot task still in progress, sleep for 2 sec.

2015-09-29 12:40:06 avvcbimage Info <14631>: create snapshot task still in progress, sleep for 2 sec.

2015-09-29 12:40:08 avvcbimage Info <14632>: snapshot create completed

2015-09-29 12:40:08 avvcbimage Info <14634>: New snapshot 'VDP-144352320260b040bb993b7031955bb04e7f28f72936cad464', moref is 'snapshot-13111'.

2015-09-29 12:40:08 avvcbimage Info <14661>: Disk Info:

  Disk '2000': file(base):'[DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk', backItUp=1

               snapshot(base) file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk'

               snapshot(curr) file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL-000001.vmdk'

               prior size(KB):20971520, current size(KB):20971520, match=1

               prior change block ID:  '52 41 f2 f9 33 b8 d9 98-53 34 94 bb 1d f9 60 3b/1569'

               current change block ID:'52 42 a0 48 94 f1 db 3a-8b eb 61 ca 1a 72 68 d9/21'

               CBTenabled=1, thin provisioned=1, independent=0, SCSI=1.

  Disk '2001': file(base):'[DS01_R6_G01_L05] E-MAIL/E-MAIL_1.vmdk', backItUp=1

               snapshot(base) file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL_1.vmdk'

               snapshot(curr) file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL_1-000001.vmdk'

               prior size(KB):20971520, current size(KB):20971520, match=1

               prior change block ID:  '52 5a 68 27 d1 26 96 eb-e6 60 94 1c c0 2c 7d 1b/1793'

               current change block ID:'52 9d 86 b7 06 7b 7b f7-03 a3 0b a3 2e 93 a8 66/24'

               CBTenabled=1, thin provisioned=1, independent=0, SCSI=1.

  Disk '2002': file(base):'[DS01_R6_G01_L05] E-MAIL/E-MAIL_2.vmdk', backItUp=1

               snapshot(base) file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL_2.vmdk'

               snapshot(curr) file:'[DS01_R6_G01_L05] E-MAIL/E-MAIL_2-000001.vmdk'

               prior size(KB):20971520, current size(KB):20971520, match=1

               prior change block ID:  '52 d9 d7 39 d0 42 43 1d-e2 67 1a 3c 74 c8 2b 8a/1569'

               current change block ID:'52 0c 92 b4 86 0a a5 10-61 4e 79 f8 c9 33 fa 46/21'

               CBTenabled=1, thin provisioned=1, independent=0, SCSI=1.

2015-09-29 12:40:09 avvcbimage Info <14696>: snapshot created:true NOMC:false ChangeBlTrackingAvail:true UsingChBl:true, FullBackup=false

2015-09-29 12:40:09 avvcbimage Info <9666>: Available transport modes are file:san:hotadd:nbdssl:nbd

2015-09-29 12:40:09 avvcbimage Info <9667>: Calling ConnectEx with servername=E-vcsa01.E.loc:443 vmxspec=moref=vm-26 on port 0 snapshot(snapshot-13111)

2015-09-29 12:40:09 avvcbimage Info <9668>: virtual machine will be connected readonly

2015-09-29 12:40:09 avvcbimage Info <9669>: VixDiskLib_ConnectEx returned VIX_OK

2015-09-29 12:40:09 avvcbimage Info <6686>: Process 17677 (/usr/local/avamarclient/bin/avtar) for workorder E-LINUX-1443523109368 started

2015-09-29 12:40:09 avvcbimage Info <9704>: spawnp->get_stdio_fd(0) on avtar with pipe #19 on start

2015-09-29 12:40:09 avvcbimage Info <7252>: Generating PAX stream blocksize 512 to path ""

2015-09-29 12:40:09 avvcbimage Info <9706>: Adding file 'avamar vm configuration.xml' (9997 bytes)

2015-09-29 12:40:09 avvcbimage Info <9706>: Adding file 'snapshot description.xml' (15 bytes)

2015-09-29 12:40:09 avvcbimage Info <9706>: Adding file 'vm.ovf' (55 bytes)

2015-09-29 12:40:09 avvcbimage Info <9706>: Adding file 'vm.vmx' (3324 bytes)

2015-09-29 12:40:09 avvcbimage Info <9706>: Adding file 'vm.nvram' (2428 bytes)

2015-09-29 12:40:09 avvcbimage Info <9761>: Creating Directory: VMFiles

2015-09-29 12:40:09 avvcbimage Info <9674>: virtual disk [DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk will be connected readonly

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVimResolveHostName: Resolving IP address for hostname E-vcsa01.E.loc:443.

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVimResolveHostName: Resolved to 192.168.2.*.

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLogin

2015-09-29 12:40:09 avvcbimage Info <10684>: Setting ctl message version to 3 (from 1)

2015-09-29 12:40:09 avvcbimage Info <16136>: Setting ctl max message size to 268435456

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: TicketFindVMByMoRef: vmxPath = -vm-26-

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLoadVM

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: Root Snapshot list has 1 elements.

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: Unable to find key for disk [DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk, trying snapshot tree.

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: TicketCollectSnapshots

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: TicketLoadSnapshot

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLoadVMCb

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: TicketLoadInternalSic

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: TicketLoadNfcTicket: Request GetVMFiles diskKey = 2000, readOnly = 1, openSnapshot = 1

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLibVim: VixDiskLibVimLogout

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLib: Thumbprint for esx02srv not found in memory database

2015-09-29 12:40:09 avvcbimage Info <16041>: VDDK:VixDiskLib: Added thumbprint CC:4F:FF:04:80:4F:E5:2D:9D:F0:26:46:F8:27:B7:C4:CE:EA:00:23 to sslIdDb for esx02srv

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:VThreadBase detected multiple threads.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.430+02:00 [7F61C3A43700 error 'cleanup'] HotAdd ManagerLoop caught an exception

2015-09-29 12:40:15 avvcbimage FATAL <5889>: Fatal signal 6 in pid 18337

2015/09/29-10:40:15.43246 []  FATAL ERROR: <0001> Fatal signal 6

2015/09/29-10:40:15.43249 []  | 00000000005de811

2015/09/29-10:40:15.43250 []  | 00000000005df4d7

2015/09/29-10:40:15.43250 []  | 00000000005e09fb

2015/09/29-10:40:15.43251 []  | 00000000005e0aee

2015/09/29-10:40:15.43251 []  | 0000000000576770

2015/09/29-10:40:15.43251 []  | 00007f61d142c6a0

2015/09/29-10:40:15.43252 []  | 00007f61cfee87a9

2015/09/29-10:40:15.43252 []  | 00007f61c551f900

2015/09/29-10:40:15.43252 []  | 00007f61c54f29ac

2015/09/29-10:40:15.43253 []  | 00007f61c5336442

2015/09/29-10:40:15.43253 []  | 00007f61caf3b72e

2015/09/29-10:40:15.43253 []  | 00007f61caf46f4c

2015/09/29-10:40:15.43254 []  | 00007f61c550fd17

2015/09/29-10:40:15.43254 []  | 00007f61c550b883

2015/09/29-10:40:15.43254 []  | 00007f61d1424696

2015/09/29-10:40:15.43255 []  | 00007f61cfeebd7d

2015/09/29-10:40:15.43261 []  ERROR: <0316> handlefatal exiting thread pid=18337, sig=6

2015-09-29 12:40:15 avvcbimage Error <5891>: handlefatal: exiting thread pid=18337, sig=6

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.433+02:00 [7F61C3A43700 panic 'Default']

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:--> Panic: Assert Failed: "_lockToken != __null" @ /build/mts/release/bora-774844/bora/lib/vcbLib/hotAdd.cpp:638

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:--> Backtrace:

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:--> backtrace[00] rip 00007f61c551f744 Vmacore::System::Stacktrace::CaptureFullWork(unsigned int)

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:--> backtrace[01] rip 000

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.435+02:00 [7F61C3A43700 panic 'Default'] (Log recursion level 2) Assert Failed: "_lockToken != __null" @ /build/mts/release/bora-774844/bora/lib/vcbLib/hotAdd.cpp:638

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.256+02:00 [7F61CC38C700 info 'Default'] Section for VMware Virtual Disk Development Kit, pid=3827, version=5.1.0, build=774844, option=Release

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.256+02:00 [7F61CC38C700 info 'Default'] Logging uses fast path: false

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.256+02:00 [7F61CC38C700 info 'Default'] Handling bora/lib logs with VmaCore facilities

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.256+02:00 [7F61CC38C700 info 'Default'] Initialized channel manager

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.256+02:00 [7F61CC38C700 info 'Default'] Current working directory: /usr/local/avamarclient/var-proxy-2

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.256+02:00 [7F61CC38C700 verbose 'ThreadPool'] Thread info: Min Io, Max Io, Min Task, Max Task, Max Thread, Keepalive, exit idle, idle secs, max fds: 2, 21, 2, 10, 31, 4, false, 600, -1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.269+02:00 [7F61CC38C700 info 'Libs'] GVMOMI request limit: -1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.914+02:00 [7F61CC38C700 info 'Default'] Vmacore::InitSSL: handshakeTimeoutUs = 20000000

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.914+02:00 [7F61CC38C700 verbose 'HttpConnectionPool-000000'] HttpConnectionPoolImpl created. maxPoolConnections = 20; idleTimeout = 900000000; maxOpenConnections = 20; maxConnectionAge = 0

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.921+02:00 [7F61C3B47700 info 'Libs'] VThreadBase detected multiple threads.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.922+02:00 [7F61C3B47700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.922+02:00 [7F61C3B47700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.922+02:00 [7F61C3B47700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.949+02:00 [7F61CC38C700 warning 'Default'] Closing Response processing in unexpected state: 3

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.951+02:00 [7F61C3A84700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.951+02:00 [7F61C3A84700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.951+02:00 [7F61C3A84700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.965+02:00 [7F61CC38C700 verbose 'HttpConnectionPool-000001'] HttpConnectionPoolImpl created. maxPoolConnections = 1; idleTimeout = 900000000; maxOpenConnections = 1; maxConnectionAge = 0

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.966+02:00 [7F61C3AC5700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.966+02:00 [7F61C3AC5700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.967+02:00 [7F61C3AC5700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.968+02:00 [7F61CC38C700 info 'cleanup'] Connected using API Namespace vim.version.version8.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:33.968+02:00 [7F61CC38C700 info 'cleanup'] Authenticating user vcsa-admin@E.loc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.061+02:00 [7F61CC38C700 info 'cleanup'] Logged in!

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.061+02:00 [7F61CC38C700 verbose 'cleanup'] Cleaning up all leftover mount points in /usr/local/avamarclient/var-proxy-2/vmware/temp

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.155+02:00 [7F61CC38C700 info 'Libs'] FILE: FileLockScanDirectory discarding M62904.lck from /usr/local/avamarclient/var-proxy-2/vmware/temp/420c94cc-7c74-52c2-7d9f-70028b55e40c-vm-39/LOCK.lck': invalid executionID.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.155+02:00 [7F61CC38C700 verbose 'cleanup'] Attempting to clean mount dir /usr/local/avamarclient/var-proxy-2/vmware/temp/420c94cc-7c74-52c2-7d9f-70028b55e40c-vm-39.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.155+02:00 [7F61CC38C700 verbose 'cleanup'] Trying to unmount /usr/local/avamarclient/var-proxy-2/vmware/temp/420c94cc-7c74-52c2-7d9f-70028b55e40c-vm-39/hotadd.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.165+02:00 [7F61CC38C700 info 'cleanup'] Performing SearchIndex find.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.252+02:00 [7F61CC38C700 info 'cleanup'] Found VM to unmount for.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.252+02:00 [7F61CC38C700 info 'cleanup'] Performing unmount on /usr/local/avamarclient/var-proxy-2/vmware/temp/420c94cc-7c74-52c2-7d9f-70028b55e40c-vm-39/hotadd

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.252+02:00 [7F61CC38C700 info 'Libs'] UUID: SMBIOS UUID is reported as '42 1f 49 86 32 5b a7 11-a2 22 96 38 ee ac 59 00'.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.252+02:00 [7F61CC38C700 info 'cleanup'] Performing SearchIndex find.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.266+02:00 [7F61CC38C700 info 'cleanup'] EndAccess: getting a hot-add instance in serial mode

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.266+02:00 [7F61CC38C700 info 'cleanup'] HotAddMgr was instantiated in serial mode.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.323+02:00 [7F61CC38C700 verbose 'cleanup'] SCSI Hot-removing the disks of VM "E-VCSA01"(vm-39), Snapshot "snapshot-13103".

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.323+02:00 [7F61C3A43700 info 'cleanup'] The HotAddMgr::ManagerLoop has started.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualIDEController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualIDEController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualPS2Controller

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualPCIController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualSIOController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualKeyboard

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualPointingDevice

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualVideoCard

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualVMCIDevice

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualLsiLogicController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualLsiLogicController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualLsiLogicController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualLsiLogicController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.345+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.370+02:00 [7F61CC38C700 info 'cleanup'] Will remove all disks belonging to VM "E-VCSA01"(vm-39), Snapshot "snapshot-13103".

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualIDEController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualIDEController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualPS2Controller

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualPCIController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualSIOController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualKeyboard

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualPointingDevice

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualVideoCard

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualVMCIDevice

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualLsiLogicController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualCdrom

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualVmxnet3

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.378+02:00 [7F61CC38C700 verbose 'cleanup'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Found hba 1000 bus 0, target 128

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Found hba 1001 bus 1, target 128

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Found hba 1002 bus 2, target 128

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Found hba 1003 bus 3, target 128

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_12-000001.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_8.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_9.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_10.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_11.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_4.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_5.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_6.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_7.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_1.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_2.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.385+02:00 [7F61CC38C700 verbose 'cleanup'] Not not scheduling disk "[iscsi_infortrend] E-VDP02/E-VDP02_3.vmdk" for removal at this time.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.389+02:00 [7F61CC38C700 verbose 'cleanup'] No disks to remove for VM "E-VCSA01"(vm-39)

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:38:34.389+02:00 [7F61CC38C700 info 'cleanup'] Remove clone disks successful.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:39:23.429+02:00 [7F61C3B47700 verbose 'HttpConnectionPool-000001'] [RemoveConnection] Connection removed; cnx: SSL(no stream); pooled: 0

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.080+02:00 [7F61C3B06700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.080+02:00 [7F61C3B06700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.080+02:00 [7F61C3B06700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.095+02:00 [7F61CC38C700 warning 'Default'] Closing Response processing in unexpected state: 3

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.095+02:00 [7F61CC38C700 info 'transport'] Connecting to host E-vcsa01.E.loc on port 443 using protocol https

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.096+02:00 [7F61C3B47700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.096+02:00 [7F61C3B47700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.097+02:00 [7F61C3B47700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.111+02:00 [7F61CC38C700 verbose 'HttpConnectionPool-000002'] HttpConnectionPoolImpl created. maxPoolConnections = 1; idleTimeout = 900000000; maxOpenConnections = 1; maxConnectionAge = 0

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.113+02:00 [7F61CC38C700 info 'transport'] Connected using API Namespace vim.version.version8.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.113+02:00 [7F61CC38C700 info 'transport'] Authenticating user vcsa-admin@E.loc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.113+02:00 [7F61C3A84700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.114+02:00 [7F61C3A84700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.114+02:00 [7F61C3A84700 warning 'Libs'] SSL_VerifyCbHelper: Certificate verification is disabled, so connection will proceed despite the error

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.207+02:00 [7F61CC38C700 info 'transport'] Logged in!

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.207+02:00 [7F61CC38C700 info 'transport'] Performing SearchIndex find.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.214+02:00 [7F61CC38C700 info 'transport'] MoRef vm-26 is a valid virtual machine.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.243+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualIDEController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.243+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualIDEController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.243+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualPS2Controller

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.243+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualPCIController

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:09.243+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualSIOController

.............

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 info 'transport'] Disk [iscsi_infortrend] E-VDP02/E-VDP02_10.vmdk is marked as independent. Ignoring for backup.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 info 'transport'] Disk [iscsi_infortrend] E-VDP02/E-VDP02_4.vmdk is marked as independent. Ignoring for backup.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 verbose 'transport'] Found a device: vim.vm.device.VirtualDisk

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.017+02:00 [7F61CC38C700 info 'transport'] Disk [iscsi_infortrend] E-VDP02/E-VDP02_5.vmdk is marked as independent. Ignoring for backup.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.146+02:00 [7F61CC38C700 info 'Default'] Establishing NFC connection to host esx02srv on port 902, service vpxa-nfc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.146+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] Using proxy/session authentication, sessionId=52 08 1c f1 c0 b3 4f ee-d6 0b 2c 03 e8 bc 68 49, useSSL=1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.344+02:00 [7F61CC38C700 info 'transport'] Established NFC session for metadata and disk signature access.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.344+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: opening disk [DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk, flags=7

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:10.455+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: Geometry: len =  21474836480, cly = 2610, head = 255, sectors = 63

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.582+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_Close: Closing file.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.594+02:00 [7F61CC38C700 info 'Default'] Establishing NFC connection to host esx02srv on port 902, service vpxa-nfc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.594+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] Using proxy/session authentication, sessionId=52 20 3f 6a f1 97 39 07-54 73 4d 89 88 9e 23 29, useSSL=1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.802+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: opening disk [DS01_R6_G01_L05] E-MAIL/E-MAIL.vmdk, flags=6

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.924+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: Geometry: len =  21474836480, cly = 2610, head = 255, sectors = 63

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.924+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrIO: write = 0, offset = 0, length = 512, type = 2

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.924+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_IO: write = 0, offset = 0, length = 512

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:11.961+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_Close: Closing file.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:12.019+02:00 [7F61CC38C700 info 'Default'] Establishing NFC connection to host esx02srv on port 902, service vpxa-nfc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:12.019+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] Using proxy/session authentication, sessionId=52 14 8d d9 86 24 6f 5f-50 09 95 92 ac cf 08 b0, useSSL=1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:12.186+02:00 [7F61CC38C700 info 'transport'] Established NFC session for metadata and disk signature access.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:12.186+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: opening disk [DS01_R6_G01_L05] E-MAIL/E-MAIL_1.vmdk, flags=7

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:12.296+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: Geometry: len =  21474836480, cly = 2610, head = 255, sectors = 63

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.452+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_Close: Closing file.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.502+02:00 [7F61CC38C700 info 'Default'] Establishing NFC connection to host esx02srv on port 902, service vpxa-nfc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.503+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] Using proxy/session authentication, sessionId=52 2b 62 4f 3f c3 db 6c-6c 3f 12 4d 5b 36 cc f8, useSSL=1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.693+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: opening disk [DS01_R6_G01_L05] E-MAIL/E-MAIL_1.vmdk, flags=6

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.826+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: Geometry: len =  21474836480, cly = 2610, head = 255, sectors = 63

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.826+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrIO: write = 0, offset = 0, length = 512, type = 2

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.826+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_IO: write = 0, offset = 0, length = 512

015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.844+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_Close: Closing file.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.845+02:00 [7F61CC38C700 info 'Libs'] Partition:Invalid sector magic number.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.866+02:00 [7F61CC38C700 info 'Default'] Establishing NFC connection to host esx02srv on port 902, service vpxa-nfc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:13.866+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] Using proxy/session authentication, sessionId=52 e3 ae 5e fd f5 4c 01-d3 17 43 a6 ec 2d a4 06, useSSL=1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:14.013+02:00 [7F61CC38C700 info 'transport'] Established NFC session for metadata and disk signature access.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:14.013+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: opening disk [DS01_R6_G01_L05] E-MAIL/E-MAIL_2.vmdk, flags=7

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:14.124+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: Geometry: len =  21474836480, cly = 2610, head = 255, sectors = 63

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.122+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_Close: Closing file.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.132+02:00 [7F61CC38C700 info 'Default'] Establishing NFC connection to host esx02srv on port 902, service vpxa-nfc

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.132+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] Using proxy/session authentication, sessionId=52 7a 06 b5 ca 3c 2a 8d-1c df 74 28 52 8b 6d 04, useSSL=1

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.266+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrClientOpen: opening disk [DS01_R6_G01_L05] E-MAIL/E-MAIL_2.vmdk, flags=6

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.394+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvrIO: write = 0, offset = 0, length = 512, type = 2

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.394+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_IO: write = 0, offset = 0, length = 512

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.416+02:00 [7F61CC38C700 info 'Libs'] [NFC DEBUG] NfcFssrvr_Close: Closing file.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.417+02:00 [7F61CC38C700 info 'Libs'] Partition:Invalid sector magic number.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.418+02:00 [7F61C3A43700 info 'cleanup'] HotAdd::ManagerLoop: processing 1 VMs in serial mode.

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.430+02:00 [7F61C3A43700 warning 'Libs'] FILE: FileLockCreateEntryDirectory creation failure on '/var/log/vmware/hotAddLock.dat.lck': No space left on device

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.430+02:00 [7F61C3A43700 error 'cleanup'] HotAdd ManagerLoop caught an exception

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.435+02:00 [7F61C3A43700 panic 'Default'] (Log recursion level 2) Assert Failed: "_lockToken != __null" @ /build/mts/release/bora-774844/bora/lib/vcbLib/hotAdd.cpp:638

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:------ In-memory logs end   --------

2015-09-29 12:40:15 avvcbimage Info <16041>: VDDK:2015-09-29T12:40:15.435+02:00 [7F61C3A43700 panic 'Default'] Section for VMware Virtual Disk Development Kit, pid=3827, version=5.1.0, build=774844, option=Release

Reply
0 Kudos
1 Reply
ctmsohio
Contributor
Contributor

I'm having a similar issue.  The first backup works fine but any incremental backups fail.

The VM has 2 VMDKs.  The first is 100GB the second is 3TB.  ESXi 5.5u2, VMFS5

VDP Snip of logs:

2016-02-07T19:45:33.263+04:00 avtar Info <5174>: - Reading /root/.avamar

2016-02-07T19:45:33.263+04:00 avtar Info <5174>: - Reading /usr/local/avamar/etc/usersettings.cfg

2016-02-07T19:45:33.263+04:00 avtar Info <5905>: Incremental flags: --flagfile=/usr/local/avamar/etc/usersettings.cfg --password=**************** --vardir=/usr/local/avamar/var --server=vdp6-round2 --id=root --bindir=/usr/local/avamar/bin --sequencenumber=1

2016-02-07T19:45:33.264+04:00 avtar Info <5946>: File system character encoding is UTF-8.

2016-02-07T19:45:33.264+04:00 avtar Info <5588>: - Creating process lock file "/usr/local/avamarclient/var/VmImage7_avtar.lck", pid=19474

2016-02-07T19:45:33.264+04:00 avtar Info <8940>: Starting back up at 2016-02-07 19:45:33 EST as "root" on "vdp6-round2" (8 CPUs) [7.1.181-107]

2016-02-07T19:45:33.264+04:00 avtar Info <5731>: Not using include/exclude list

2016-02-07T19:45:33.264+04:00 avtar Info <8474>: - Log file path: vdp6-mentordc-file0.neomarketing.com-1454892262483-41bdc97c94c1c09324d00831aeb5a9273be1f896-3016-vmimagew_avtar.log

2016-02-07T19:45:33.264+04:00 avtar Info <6555>: Initializing connection (Avamar Deduplication Engine v2.0.0)

2016-02-07T19:45:33.264+04:00 avtar Info <5552>: Connecting to Avamar Server (vdp6-round2.locsol.local)

2016-02-07T19:45:33.264+04:00 avtar Info <5554>: Connecting to one node in each datacenter

2016-02-07T19:45:33.271+04:00 avtar Info <5993>: - Connect: Connected to 10.13.37.177:29000, Priv=0, SSL Cipher=AES256-SHA

2016-02-07T19:45:33.279+04:00 avtar Info <5993>: - Datacenter 0 has 1 nodes: Connected to 10.13.37.177:29000, Priv=0, SSL Cipher=AES256-SHA

2016-02-07T19:45:33.283+04:00 avtar Info <5581>: Logging in on connection 0 with Session Ticket

2016-02-07T19:45:33.283+04:00 avtar Info <5582>: Avamar Server login successful

2016-02-07T19:45:33.283+04:00 avtar Info <5018>: - Session ID: 0

2016-02-07T19:45:33.287+04:00 avtar Info <10632>: Using Client-ID='41bdc97c94c1c09324d00831aeb5a9273be1f896'

2016-02-07T19:45:33.288+04:00 avtar Info <5550>: Successfully logged into Avamar Server [7.1.81-107] (Compression enabled)

2016-02-07T19:45:33.288+04:00 avtar Info <7562>: Back up of stdin on server "vdp6-round2.locsol.local" for /10.13.37.175/VirtualMachines/file0.neomarketing.local_UsPQ0dPd9aQde7BWSiJBUA

2016-02-07T19:45:33.293+04:00 avtar Info <5586>: Loading cache files from /usr/local/avamarclient/var

2016-02-07T19:45:33.293+04:00 avtar Info <5769>: Filecache is disabled.

2016-02-07T19:45:33.293+04:00 avtar Info <8650>: Opening hash cache file '/usr/local/avamarclient/var/VmImage7_p_cache.dat'

2016-02-07T19:45:36.891+04:00 avtar Info <5573>: - Loaded hash cache file (402,653,728 bytes)

2016-02-07T19:45:38.326+04:00 avtar Info <6426>: Done loading cache files

2016-02-07T19:45:38.327+04:00 avtar Warning <18692>: Changed streamformat-out to none since raw format is only for DDR use

2016-02-07T19:45:38.327+04:00 avtar Info <6995>: Parsing 'pax' stream format from stdin

2016-02-07T19:45:38.332+04:00 avtar Info <8478>: Using backup #1 timestamp 2016-01-23 04:21:18 EST label "vdp6-round2-backup-all-mentordc-1453487883770" as base for incremental backup

2016-02-07T19:45:38.332+04:00 avtar Info <10818>: Backstream creating root backstreamdir object

2016-02-07T19:45:38.332+04:00 avtar Info <8648>: Directory elements will be sorted: No

2016-02-07T19:45:38.332+04:00 avtar Info <8649>: Sub-file change blocks enabled: Yes

2016-02-07T19:45:57.511+04:00 avtar Info <10695>: Processing 8673 changeblocks for "virtdisk-flat.vmdk" (64,424,509,440 bytes)

2016-02-07T19:47:10.090+04:00 avtar Info <10698>: - Changeblock #868 offset=1882128384, bytes=1441792

2016-02-07T19:48:22.313+04:00 avtar Info <10698>: - Changeblock #1736 offset=4064739328, bytes=65536

2016-02-07T19:49:36.617+04:00 avtar Info <10698>: - Changeblock #2604 offset=7081951232, bytes=131072

2016-02-07T19:50:53.360+04:00 avtar Info <10698>: - Changeblock #3472 offset=10441719808, bytes=327680

2016-02-07T19:52:15.644+04:00 avtar Info <10698>: - Changeblock #4340 offset=13863616512, bytes=1572864

2016-02-07T19:53:32.106+04:00 avtar Info <10698>: - Changeblock #5208 offset=16902848512, bytes=196608

2016-02-07T19:54:51.763+04:00 avtar Info <10698>: - Changeblock #6076 offset=21027487744, bytes=65536

2016-02-07T19:56:49.164+04:00 avtar Info <10698>: - Changeblock #6944 offset=34163392512, bytes=3014656

2016-02-07T19:58:29.529+04:00 avtar Info <10698>: - Changeblock #7812 offset=39264452608, bytes=65536

2016-02-07T20:00:33.492+04:00 avtar Info <8688>: Status 2016-02-07 20:00:33, 53.69 GB (22.56 MB, 0.04% new) 825MB  33% CPU  23092130816 input bytes, (1 open files) VMFiles/1/virtdisk-flat.vmdk

2016-02-07T20:01:56.372+04:00 [avtar]  INTERNAL ERROR: <0001> assert error (len > 0 && bits > 0), /local/jenkins/workspace/client_Toystory2015_SLES11-64/abs2/work/src/common/bitvect.cpp line 22

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000a55821

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000a56597

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000a56702

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000a5686e

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000a56ced

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000009e6386

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000602caf

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000604be4

2016-02-07T20:01:56.372+04:00 [avtar]  | 000000000079abcc

2016-02-07T20:01:56.372+04:00 [avtar]  | 000000000079c69d

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000005a57ad

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000590e56

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000005931a6

2016-02-07T20:01:56.372+04:00 [avtar]  | 000000000049dceb

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000004a355b

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000004a4b10

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000009a8fe9

2016-02-07T20:01:56.372+04:00 [avtar]  | 00000000004b0027

2016-02-07T20:01:56.372+04:00 [avtar]  | 00007fd92387bbf6

2016-02-07T20:01:56.372+04:00 [avtar]  | 0000000000458029

2016-02-07T20:01:56.372+04:00 avtar FATAL <5889>: Fatal signal 11 in pid 19474

2016-02-07T20:01:56.373+04:00 [avtar]  FATAL ERROR: <0001> uapp::handlefatal: Fatal signal 11

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000a55821

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000a56597

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000a568bb

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000a569ae

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000009a7440

2016-02-07T20:01:56.373+04:00 [avtar]  | 00007fd9257e0710

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000009e633c

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000602caf

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000604be4

2016-02-07T20:01:56.373+04:00 [avtar]  | 000000000079abcc

2016-02-07T20:01:56.373+04:00 [avtar]  | 000000000079c69d

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000005a57ad

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000590e56

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000005931a6

2016-02-07T20:01:56.373+04:00 [avtar]  | 000000000049dceb

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000004a355b

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000004a4b10

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000009a8fe9

2016-02-07T20:01:56.373+04:00 [avtar]  | 00000000004b0027

2016-02-07T20:01:56.373+04:00 [avtar]  | 00007fd92387bbf6

2016-02-07T20:01:56.373+04:00 [avtar]  | 0000000000458029

2016-02-07T20:01:56.373+04:00 [avtar]  ERROR: <0001> uapp::handlefatal: aborting program pid=19474, sig=11

2016-02-07T20:01:56.374+04:00 avtar FATAL <5890>: handlefatal: Aborting program with code 176, pid=19474, sig=11

*********** /usr/local/avamarclient/var/vdp6-mentordc-file0.neomarketing.com-1454892262483-41bdc97c94c1c09324d00831aeb5a9273be1f896-3016-vmimagew.log ***********

     ==>> Size limit exceeded, unable to transmit file. <<==

*********** /usr/local/avamarclient/var/vdp6-mentordc-file0.neomarketing.com-1454892262483-41bdc97c94c1c09324d00831aeb5a9273be1f896-3016-vmimagew.alg ***********

<logheader platform="Linux" env-locale-cs="ANSI_X3.4-1968" process_id="vdp6-mentordc-file0.neomarketing.com-1454892262483" version="7.1.181-107" tz="EST" />

--------------------------------------------------------------------------------------------------------

-----  START vdp6-mentordc-file0.neomarketing.com-1454892262483 log 2016-02-07 19:44:22 EST  [7.1.181-107 Linux-x86_64]

--------------------------------------------------------------------------------------------------------

Reply
0 Kudos