VMware Cloud Community
jonathanp
Expert
Expert

VM power off somewhere between snapshot creation / removal.

Here are some of the error we see linked to that event.

That happened during a backup that create snapshot before and remove it after.

Error in VC:

An error occurred while restarting virtual machine after taking a snapshot. The virtual machine will be powered off.

Reason: 0 (No such device or address).

Error in Logs:

2014-12-26T03:26:57.620Z| vcpu-0| DISKLIB-LIB   : CREATE CHILD: "/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk" -- vmfsSparse cowGran=1

2014-12-26T03:26:57.620Z| vcpu-0| DISKLIB-LIB   : Resuming change tracking.

2014-12-26T03:26:57.627Z| vcpu-0| DISKLIB-VMFS_SPARSE : VmfsSparseExtentCreate: "/vmfs/volumes/datastore/VMname1/VMname1_1-000001-delta.vmdk" : success

2014-12-26T03:26:57.629Z| vcpu-0| DISKLIB-DSCPTR: "/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk" : creation successful.

2014-12-26T03:26:57.631Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_1-000001-delta.vmdk" : open successful (17) size = 94208, hd = 0.

2014-12-26T03:26:57.748Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_1-000001-delta.vmdk" : closed.

2014-12-26T03:26:57.748Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_1-flat.vmdk" : closed.

2014-12-26T03:26:57.749Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_2-flat.vmdk" : open successful (29) size = 5368709120, hd = 0. Typ

2014-12-26T03:26:57.750Z| vcpu-0| DISKLIB-LIB   : DiskLibCreateCreateParam: vmfssparse grain size set to : 1

2014-12-26T03:26:57.750Z| vcpu-0| DISKLIB-LIB   : CREATE CHILD: "/vmfs/volumes/datastore/VMname1/VMname1_2-000001.vmdk" -- vmfsSparse cowGran=1

2014-12-26T03:26:57.750Z| vcpu-0| DISKLIB-LIB   : Resuming change tracking.

2014-12-26T03:26:57.757Z| vcpu-0| DISKLIB-VMFS_SPARSE : VmfsSparseExtentCreate: "/vmfs/volumes/datastore/VMname1/VMname1_2-000001-delta.vmdk" : success

2014-12-26T03:26:57.760Z| vcpu-0| DISKLIB-DSCPTR: "/vmfs/volumes/datastore/VMname1/VMname1_2-000001.vmdk" : creation successful.

2014-12-26T03:26:57.762Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_2-000001-delta.vmdk" : open successful (17) size = 12288, hd = 0.

2014-12-26T03:26:57.785Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_2-000001-delta.vmdk" : closed.

2014-12-26T03:26:57.786Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_2-flat.vmdk" : closed.

2014-12-26T03:26:57.799Z| vcpu-0| CPT current = 2, requesting 6

2014-12-26T03:26:57.799Z| vcpu-0| Checkpoint_Unstun: vm stopped for 572703 us

2014-12-26T03:26:57.799Z| vcpu-0| SCSI: switching scsi0 to push completion mode

2014-12-26T03:26:57.799Z| vcpu-1| Done Sync monModules(6).

2014-12-26T03:26:57.799Z| vcpu-0| Done Sync monModules(6).

2014-12-26T03:26:57.799Z| vcpu-0| CPT: monitor ACKing mode 6

2014-12-26T03:26:57.800Z| vcpu-0| DISK: OPEN scsi0:0 '/vmfs/volumes/datastore/VMname1/VMname1-000001.vmdk' persistent R[]

2014-12-26T03:26:57.801Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1-000001-delta.vmdk" : open successful (10) size = 102400, hd = 2761

2014-12-26T03:26:57.801Z| vcpu-0| DISKLIB-DSCPTR: Opened [0]: "VMname1-000001-delta.vmdk" (0xa)

2014-12-26T03:26:57.801Z| vcpu-0| DISKLIB-LINK  : Opened '/vmfs/volumes/datastore/VMname1/VMname1-000001.vmdk' (0xa): vmfsSparse, 100663296 sectors / 48 GB.

2014-12-26T03:26:57.803Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1-flat.vmdk" : open successful (14) size = 51539607552, hd = 2623514

2014-12-26T03:26:57.803Z| vcpu-0| DISKLIB-DSCPTR: Opened [0]: "VMname1-flat.vmdk" (0xe)

2014-12-26T03:26:57.803Z| vcpu-0| DISKLIB-LINK  : Opened '/vmfs/volumes/datastore/VMname1/VMname1.vmdk' (0xe): vmfs, 100663296 sectors / 48 GB.

2014-12-26T03:26:57.803Z| vcpu-0| DISKLIB-CHAINESX : ChainESXOpenSubChain: numLinks = 2, numSubChains = 1

2014-12-26T03:26:57.805Z| vcpu-0| DISKLIB-LIB   : Resuming change tracking.

2014-12-26T03:26:57.806Z| vcpu-0| DISKLIB-CBT   : Initializing ESX kernel change tracking for fid 276113990.

2014-12-26T03:26:57.806Z| vcpu-0| DISKLIB-CBT   : Successfuly created cbt node 11752a49-cbt.

2014-12-26T03:26:57.806Z| vcpu-0| DISKLIB-CBT   : Opening cbt node /vmfs/devices/cbt/11752a49-cbt

2014-12-26T03:26:57.806Z| vcpu-0| DISKLIB-LIB   : Opened "/vmfs/volumes/datastore/VMname1/VMname1-000001.vmdk" (flags 0xa, type vmfs).

2014-12-26T03:26:57.806Z| vcpu-0| DISK: Disk '/vmfs/volumes/datastore/VMname1/VMname1-000001.vmdk' has UUID '60 00 c2 99 f3 6f 1e 63-73 92 f1 d5 f7 fa c0 0f'

2014-12-26T03:26:57.806Z| vcpu-0| DISK: OPEN '/vmfs/volumes/datastore/VMname1/VMname1-000001.vmdk' Geo (6266/255/63) BIOS Geo (0/0/0)

2014-12-26T03:26:57.806Z| vcpu-0| Creating virtual dev for scsi0:0

2014-12-26T03:26:57.806Z| vcpu-0| DumpDiskInfo: scsi0:0 createType=11, capacity = 100663296, numLinks = 2, allocationType = 0

2014-12-26T03:26:57.807Z| vcpu-0| SCSIDiskESXPopulateVDevDesc: Using FS backend

2014-12-26T03:26:57.807Z| vcpu-0| DISKUTIL: scsi0:0 : geometry=6266/255/63

2014-12-26T03:26:57.807Z| vcpu-0| DISK: OPEN scsi0:1 '/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk' persistent R[]

2014-12-26T03:27:10.807Z| vcpu-0| FileIOErrno2Result: Unexpected errno=6, No such device or address

2014-12-26T03:27:10.807Z| vcpu-0| AIOGNRC: Failed to open '/vmfs/volumes/datastore/VMname1/VMname1_1-000001-delta.vmdk' : No such device or address (60000000

2014-12-26T03:27:10.807Z| vcpu-0| DISKLIB-VMFS  : "/vmfs/volumes/datastore/VMname1/VMname1_1-000001-delta.vmdk" : failed to open (No such device or address):

2014-12-26T03:27:10.807Z| vcpu-0| DISKLIB-LINK  : "/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk" : failed to open (No such device or address).

2014-12-26T03:27:10.807Z| vcpu-0| DISKLIB-CHAIN : "/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk" : failed to open (No such device or address).

2014-12-26T03:27:10.807Z| vcpu-0| DISKLIB-LIB   : Failed to open '/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk' with flags 0xa No such device or address

2014-12-26T03:27:10.807Z| vcpu-0| DISK: Cannot open disk "/vmfs/volumes/datastore/VMname1/VMname1_1-000001.vmdk": No such device or address (393225).

2014-12-26T03:27:10.807Z| vcpu-0| Msg_Post: Error

Some other logs I see related to the luns where the VM sits and also some NetPort messages that I am not sure have something to do with that..:

2014-12-26T03:26:57.228Z cpu30:10205)NetPort: 1437: disabled port 0x3000004

2014-12-26T03:26:57.229Z cpu30:10205)NetPort: 1437: disabled port 0x1000006

2014-12-26T03:26:57.229Z cpu30:10205)NetPort: 1437: disabled port 0x1000005

2014-12-26T03:26:57.245Z cpu30:10205)CBT: 692: Disconnecting the cbt device 2a952a20-cbt with filehandle 714418720

2014-12-26T03:26:57.280Z cpu30:10205)CBT: 692: Disconnecting the cbt device 47e82a1d-cbt with filehandle 1206397469

2014-12-26T03:26:57.314Z cpu30:10205)CBT: 692: Disconnecting the cbt device 116c12a19-cbt with filehandle 4676725273

2014-12-26T03:26:57.806Z cpu30:10205)CBT: 1082: Created device 11752a49-cbt for cbt driver with filehandle 292891209

2014-12-26T03:26:57.807Z cpu30:10205)VSCSI: 3654: handle 11852(vscsi0:0):Using sync mode due to sparse disks

2014-12-26T03:26:57.807Z cpu30:10205)VSCSI: 3695: handle 11852(vscsi0:0):Creating Virtual Device for world 10019 (FSS handle 192490059)

2014-12-26T03:27:10.807Z cpu18:4114)NMP: nmp_ThrottleLogForDevice:2318: Cmd 0x89 (0x412441f23ec0, 10205) to dev "naa.60055555555ab00000000000123" on path "vmhba1:C0:T7:L2" Failed: H:0xb D:0x0

2014-12-26T03:27:10.807Z cpu18:4114)ScsiDeviceIO: 2313: Cmd(0x412441f23ec0) 0x89, CmdSN 0x4f018b from world 10205 to dev "naa.60055555555ab00000000000123" failed H:0xb D:0x0 P:0x0 Possible sen

2014-12-26T03:27:10.818Z cpu30:10205)NetPort: 2612: resuming traffic on DV port 103

2014-12-26T03:27:10.818Z cpu30:10205)NetPort: 1250: enabled port 0x3000004 with mac 00:50:56:92:69:A1

2014-12-26T03:27:10.818Z cpu30:10205)NetPort: 1250: enabled port 0x1000006 with mac 00:50:56:92:69:A2

2014-12-26T03:27:10.819Z cpu30:10205)NetPort: 1250: enabled port 0x1000005 with mac 00:50:56:92:6a:A3

2014-12-26T03:27:10.837Z cpu21:4157)NetPort: 1437: disabled port 0x1000005

2014-12-26T03:27:10.837Z cpu21:4157)NetPort: 1437: disabled port 0x1000006

2014-12-26T03:27:10.838Z cpu21:4157)NetPort: 1437: disabled port 0x3000004

2014-12-26T03:27:10.838Z cpu21:4157)Net: 2197: disconnected client from port 0x1000005

2014-12-26T03:27:10.838Z cpu21:4157)Net: 2197: disconnected client from port 0x1000006

2014-12-26T03:27:10.838Z cpu21:4157)Net: 2193: dissociate dvPort 103 from port 0x3000004

2014-12-26T03:27:10.838Z cpu21:4157)Net: 2197: disconnected client from port 0x3000004

Reply
0 Kudos
0 Replies