hello guys,
my datastore missing, please help...
it was 2 datastore, but 1 missing after reboot.
but the disk is detected. thx for your help
For unknown reasons the size of the vmfs-volume is off by 3072 bytes = 6 sectors to what it is supposed to be.
Check the voma-screen.
That appears to be the only error according to voma - but I dont know wether voma stops at such a critical error ?
Anyway - the next thing you have to do is to adjust the partitionable by setting a new endsector for the vmfs-volume.
Stop all other experiments.
Ulli
Did you try to force mount the datastore ?
NOTE : Do not format the existing lun by any chance or click on any unknown option which may lead to data loss.
Check if that lun is detected as a snapshot lun after reboot, if yes then that should be the reason why datastore went missing.
Check out below community and KB :
ESXi 6.0 loses datastores after rebooting
Below command gives you the lun which is detected as snapshot, check if that lun is showing as snapshot lun when you execute this command.
esxcli storage vmfs snapshot list
Please consider marking this answer as correct and helpful if this helps you.
regards
Gayathri
when i try your command :
login as: root
Using keyboard-interactive authentication.
Password:
The time and date of this login have been sent to the system logs.
VMware offers supported, powerful system administration tools. Please
see www.vmware.com/go/sysadmintools for details.
The ESXi Shell can be disabled by an administrative user. See the
vSphere Security documentation for more information.
[root@localhost:~] excli storage vmfs snapshot list
-sh: excli: not found
[root@localhost:~]
There is an "s" missing.. esxcli
Regards,
Joerg
sorry my typo, but when i re enter command
[root@localhost:~] esxcli storage vmfs snapshot list
[root@localhost:~]
nothing happend
when i use voma the result say 1 error..
some logs :
2018-12-24T10:26:52.860Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T10:26:52.860Z cpu4:65565)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x28 (0x439500bb9400, 66713) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $
2018-12-24T10:26:52.860Z cpu4:65565)ScsiDeviceIO: 2962: Cmd(0x439500bb9400) 0x28, CmdSN 0x8 from world 66713 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T10:29:28.708Z cpu2:70190)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T10:29:32.296Z cpu0:67589)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T10:29:32.296Z cpu0:67589)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T10:29:32.296Z cpu1:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T10:29:32.296Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T10:29:32.296Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T10:29:32.308Z cpu1:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T10:29:32.311Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T10:29:32.312Z cpu0:65561)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x28 (0x439500bfd100, 70190) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $
2018-12-24T10:29:32.312Z cpu0:65561)ScsiDeviceIO: 2962: Cmd(0x439500bfd100) 0x28, CmdSN 0x8 from world 70190 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T10:29:32.330Z cpu0:70190)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T10:29:35.940Z cpu2:66028)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T10:29:35.940Z cpu2:66028)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T10:29:35.941Z cpu1:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T10:29:35.941Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T10:29:35.941Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T10:29:35.953Z cpu1:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T10:29:35.956Z cpu1:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T10:29:35.956Z cpu2:65563)ScsiDeviceIO: 2962: Cmd(0x439500a70b00) 0x28, CmdSN 0x8 from world 70190 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T10:29:36.022Z cpu0:70190)Resv: 407: Executed out-of-band reserve on t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU
Please be very careful here :
NOTE: Do not proceed with creation of datastore again , just to know what does it shows there .
As you said LUN assignment is still there, what does it show if you click add storage and select that particular lun ( DO NOT proceed on creating as this lead to data loss)
attach the screen .
Also try run a rescan and post all this attach vmkernel log file and provide the datastore name.
regards
Gayathri
i cant add new datastore
here is vmkernel log :
2018-12-24T12:05:56.335Z cpu4:65999)NMP: nmp_ResetDeviceLogThrottling:3348: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 9 times
2018-12-24T12:05:56.523Z cpu7:66100)Tcpip: 2998: msleep returned 4
2018-12-24T12:05:58.477Z cpu0:65720)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:05:58.477Z cpu0:65720)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:05:58.477Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:05:58.477Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:05:58.477Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:05:58.490Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:05:58.493Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:05:58.493Z cpu0:65561)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x28 (0x439500b54d80, 69967) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $
2018-12-24T12:05:58.493Z cpu0:65561)ScsiDeviceIO: 2962: Cmd(0x439500b54d80) 0x28, CmdSN 0x8 from world 69967 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:05:58.612Z cpu5:69984)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:05:59.849Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "vvol" "storagecontainer" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:00.772Z INFO runcommand called with: args = '/sbin/localcli --formatter python "hardware" "pci" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:00.889Z INFO runcommand called with: args = '/sbin/localcli --formatter python "iscsi" "physicalnetworkportal" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:00.959Z INFO runcommand called with: args = '/sbin/localcli --formatter python "iscsi" "networkportal" "list" "--adapter" "vmhba64" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:01.035Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "vvol" "vasaprovider" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:01.116Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "nmp" "device" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:01.185Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "vvol" "vasacontext" "get" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:01.323Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "nmp" "device" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:01.394Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "nmp" "device" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:01.465Z DEBUG Querying disks
2018-12-24T12:06:01.466Z DEBUG Executing: localcli --formatter=json vsan storage list
2018-12-24T12:06:01.540Z INFO b'\n[\n]\n'
2018-12-24T12:06:01.653Z DEBUG lun -- t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____
2018-12-24T12:06:01.654Z DEBUG Trying /vmfs/devices/disks/t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____
2018-12-24T12:06:01.902Z DEBUG Found overlap in fsTable: 'vmfs3' .. overriding '<class 'weasel.fsset.vmfs3FileSystem'>' with '<class 'weasel.fsset.vmfs3FileSystem'>'.
2018-12-24T12:06:01.902Z DEBUG Executing: partedUtil getptbl /vmfs/devices/disks/t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____
2018-12-24T12:06:02.164Z INFO b'gpt\n60801 255 63 976773168\n1 64 8191 C12A7328F81F11D2BA4B00A0C93EC93B systemPartition 128\n5 8224 520191 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0\n6 520224 1032191 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative $
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['1', '64', '8191', 'C12A7328F81F11D2BA4B00A0C93EC93B', 'systemPartition', '128']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['5', '8224', '520191', 'EBD0A0A2B9E5443387C068B6B72699C7', 'linuxNative', '0']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['6', '520224', '1032191', 'EBD0A0A2B9E5443387C068B6B72699C7', 'linuxNative', '0']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['7', '1032224', '1257471', '9D27538040AD11DBBF97000C2911D1B8', 'vmkDiagnostic', '0']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['8', '1257504', '1843199', 'EBD0A0A2B9E5443387C068B6B72699C7', 'linuxNative', '0']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['9', '1843200', '7086079', '9D27538040AD11DBBF97000C2911D1B8', 'vmkDiagnostic', '0']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['2', '7086080', '15472639', 'EBD0A0A2B9E5443387C068B6B72699C7', 'linuxNative', '0']'.
2018-12-24T12:06:02.165Z DEBUG Got partGeom: '['3', '15472640', '976773134', 'AA31E02A400F11DB9590000C2911D1B8', 'vmfs', '0']'.
2018-12-24T12:06:02.199Z cpu6:66080)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:02.199Z cpu6:66080)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:02.199Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:02.199Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:02.199Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:02.211Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:02.215Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:02.215Z cpu6:65567)ScsiDeviceIO: 2962: Cmd(0x4395009dce80) 0x28, CmdSN 0x8 from world 69984 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:02.234Z cpu7:70050)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:02.244Z cpu1:70050)VC: 4511: Device rescan time 68 msec (total number of devices 5)
2018-12-24T12:06:02.244Z cpu1:70050)VC: 4514: Filesystem probe time 9 msec (devices probed 3 of 5)
2018-12-24T12:06:02.244Z cpu1:70050)VC: 4516: Refresh open volume time 1 msec
2018-12-24T12:06:02.244Z DEBUG Executing: localcli storage filesystem automount
2018-12-24T12:06:02.250Z cpu2:67591)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:05.855Z cpu2:65639)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:05.855Z cpu2:65639)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:05.855Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:05.855Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:05.855Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:05.867Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:05.870Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:05.871Z cpu2:65563)ScsiDeviceIO: 2962: Cmd(0x439500bd6900) 0x28, CmdSN 0x8 from world 66715 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:05.889Z cpu1:70107)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:09.477Z cpu2:65639)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:09.477Z cpu2:65639)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:09.477Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:09.477Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:09.477Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:09.490Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:09.493Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:09.493Z cpu2:65563)ScsiDeviceIO: 2962: Cmd(0x439500bc7080) 0x28, CmdSN 0x8 from world 70107 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:09.499Z INFO b''
2018-12-24T12:06:09.534Z cpu3:67591)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:09.944Z cpu0:65854)BC: 3571: Pool 0: Blocking due to no free buffers. nDirty = 229 nWaiters = 1
2018-12-24T12:06:13.122Z cpu7:65720)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:13.122Z cpu7:65720)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:13.122Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:13.122Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:13.122Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:13.134Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:13.137Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:13.137Z cpu0:65561)ScsiDeviceIO: 2962: Cmd(0x439500a6e480) 0x28, CmdSN 0x8 from world 66715 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:13.167Z cpu1:67602 opID=a6fd1760)World: 12230: VC opID 5E0F3DFF-00000039-2f1c maps to vmkernel opID a6fd1760
2018-12-24T12:06:13.167Z cpu1:67602 opID=a6fd1760)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:13.175Z cpu4:67602 opID=a6fd1760)VC: 4511: Device rescan time 16 msec (total number of devices 5)
2018-12-24T12:06:13.175Z cpu4:67602 opID=a6fd1760)VC: 4514: Filesystem probe time 8 msec (devices probed 3 of 5)
2018-12-24T12:06:13.175Z cpu4:67602 opID=a6fd1760)VC: 4516: Refresh open volume time 1 msec
2018-12-24T12:06:13.176Z cpu4:67602 opID=a6fd1760)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:16.788Z cpu3:65544)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:16.788Z cpu3:65544)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:16.788Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:16.788Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:16.788Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:16.800Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:16.803Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:16.803Z cpu3:65564)ScsiDeviceIO: 2962: Cmd(0x439500bb1600) 0x28, CmdSN 0x8 from world 66715 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:16.822Z cpu1:70050)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:20.410Z cpu3:65712)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:20.410Z cpu3:65712)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:20.410Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:20.410Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:20.410Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:20.422Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:20.425Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:20.425Z cpu3:65564)ScsiDeviceIO: 2962: Cmd(0x439500a44b80) 0x28, CmdSN 0x8 from world 70050 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:20.467Z cpu3:67602 opID=a6fd1760)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:21.822Z cpu3:65564)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x2a (0x439500b84180, 65551) to dev "t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____" on path "vmhba0:C0:T1:L0" Failed: H:0x2 D:0x0 P:0x0 Invalid sense $
2018-12-24T12:06:21.822Z cpu3:65564)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____" state in doubt; requested fast path state update...
2018-12-24T12:06:21.822Z cpu3:65564)ScsiDeviceIO: 2927: Cmd(0x439500b84180) 0x2a, CmdSN 0xa1 from world 65551 to dev "t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____" failed H:0x2 D:0x0 P:0x0 Invalid sense data: 0x75 0x70 0x64.
2018-12-24T12:06:21.938Z cpu3:66080)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____ repeated 10 times
2018-12-24T12:06:22.183Z cpu3:66080)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____ repeated 20 times
2018-12-24T12:06:22.342Z cpu3:66080)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____" state in doubt; requested fast path state update...
2018-12-24T12:06:22.400Z cpu7:65568)ScsiDeviceIO: 2927: Cmd(0x439500ace500) 0x2a, CmdSN 0xa9 from world 65551 to dev "t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____" failed H:0x2 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0.
2018-12-24T12:06:22.700Z cpu7:66080)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____ repeated 40 times
2018-12-24T12:06:24.055Z cpu7:66028)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:24.055Z cpu7:66028)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:24.055Z cpu7:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:24.055Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:24.055Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x6
2018-12-24T12:06:24.067Z cpu7:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:24.070Z cpu7:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 2 commands
2018-12-24T12:06:24.070Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500a25000) 0x28, CmdSN 0x8 from world 66715 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:24.070Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x4395009aa280) 0x28, CmdSN 0xdb4 from world 0 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:24.070Z cpu0:67195)Partition: 427: Failed read for "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU": I/O error
2018-12-24T12:06:24.070Z cpu0:67195)Partition: 1007: Failed to read protective mbr on "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" : I/O error
2018-12-24T12:06:24.070Z cpu0:67195)WARNING: Partition: 1158: Partition table read from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU failed: I/O error
2018-12-24T12:06:24.089Z INFO Discovered lun -- t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____ (console /vmfs/devices/disks/t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____) -- ATA Samsung SSD 8$
2018-12-24T12:06:24.089Z DEBUG lun -- t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU
2018-12-24T12:06:24.090Z DEBUG Trying /vmfs/devices/disks/t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU
2018-12-24T12:06:24.090Z cpu7:70050)FSS: 6214: Conflict between buffered and unbuffered open (file 't10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU'):flags 0x1, requested flags 0x4005
2018-12-24T12:06:24.090Z cpu0:65561)NMP: nmp_ThrottleLogForDevice:3563: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 8 times
2018-12-24T12:06:24.090Z cpu0:65561)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x9e (0x439500a97300, 0) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Invalid sense da$
2018-12-24T12:06:24.090Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" state in doubt; requested fast path state update...
2018-12-24T12:06:24.090Z cpu0:65561)ScsiDeviceIO: 2927: Cmd(0x439500a97300) 0x9e, CmdSN 0xdc6 from world 0 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x2 D:0x0 P:0x0 Invalid sense data: 0x65 0x20 0x75.
2018-12-24T12:06:24.219Z cpu0:65561)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 10 times
2018-12-24T12:06:24.338Z cpu6:65567)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" state in doubt; requested fast path state update...
2018-12-24T12:06:24.492Z cpu6:65567)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 20 times
2018-12-24T12:06:25.048Z cpu5:65566)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 40 times
2018-12-24T12:06:26.185Z cpu5:65566)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 80 times
2018-12-24T12:06:26.887Z DEBUG Found overlap in fsTable: 'vmfs3' .. overriding '<class 'weasel.fsset.vmfs3FileSystem'>' with '<class 'weasel.fsset.vmfs3FileSystem'>'.
2018-12-24T12:06:26.887Z DEBUG Executing: partedUtil getptbl /vmfs/devices/disks/t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU
2018-12-24T12:06:26.924Z INFO b'gpt\n243201 255 63 3907029168\n1 128 3907029134 AA31E02A400F11DB9590000C2911D1B8 vmfs 0\n'
2018-12-24T12:06:26.924Z DEBUG Got partGeom: '['1', '128', '3907029134', 'AA31E02A400F11DB9590000C2911D1B8', 'vmfs', '0']'.
2018-12-24T12:06:26.925Z INFO Discovered lun -- t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU (console /vmfs/devices/disks/t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU) -- ATA WDC WD20E$
2018-12-24T12:06:26.928Z INFO Scanning t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____ for any installs ...
2018-12-24T12:06:26.928Z INFO Load vfat, rescanVmfs and automount all at once.
2018-12-24T12:06:26.933Z cpu5:70050)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:26.947Z cpu5:70050)VC: 4511: Device rescan time 6 msec (total number of devices 5)
2018-12-24T12:06:26.947Z cpu5:70050)VC: 4514: Filesystem probe time 11 msec (devices probed 4 of 5)
2018-12-24T12:06:26.947Z cpu5:70050)VC: 4516: Refresh open volume time 0 msec
2018-12-24T12:06:26.947Z DEBUG Executing: localcli storage filesystem automount
2018-12-24T12:06:26.948Z cpu7:67601)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:30.532Z cpu7:70280)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:30.532Z cpu7:70280)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:30.532Z cpu4:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:30.532Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:30.532Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:30.545Z cpu4:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:30.548Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:30.548Z cpu7:65568)NMP: nmp_ThrottleLogForDevice:3563: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 41 times
2018-12-24T12:06:30.548Z cpu7:65568)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x28 (0x439500a0a180, 66715) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $
2018-12-24T12:06:30.548Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500a0a180) 0x28, CmdSN 0x8 from world 66715 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:30.566Z cpu4:70312)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:34.154Z cpu4:66100)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:34.154Z cpu4:66100)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:34.154Z cpu4:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:34.154Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:34.154Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:34.167Z cpu4:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:34.170Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:34.170Z cpu4:65565)ScsiDeviceIO: 2962: Cmd(0x4395009aa280) 0x28, CmdSN 0x8 from world 70312 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:34.178Z INFO b''
2018-12-24T12:06:34.211Z cpu7:67601)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:37.799Z cpu7:66078)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:37.799Z cpu7:66078)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:37.799Z cpu4:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:37.799Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:37.799Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:37.811Z cpu4:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:37.814Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:37.814Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500a0a180) 0x28, CmdSN 0x8 from world 66715 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:40.187Z DEBUG Found locker partition 8
2018-12-24T12:06:40.187Z DEBUG Found bootbank partition 6
2018-12-24T12:06:40.187Z DEBUG Found bootbank partition 5
2018-12-24T12:06:40.188Z DEBUG Parsing bootconfig file: /vmfs/volumes/13d38f74-40445b41-2604-b41eca40add3/boot.cfg
2018-12-24T12:06:40.189Z DEBUG Parsing bootconfig file: /vmfs/volumes/b32a2e71-144cd3f5-633a-d3f03a0d9de6/boot.cfg
2018-12-24T12:06:40.190Z INFO Found ESXi on t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____: {esx : False; esxi : True; lopsided : None; version: (6, 5, 0)}.
2018-12-24T12:06:40.198Z INFO runcommand called with: args = '['/bin/indcfg', '--read', '/tmp/hp_cim_ind_cfg_pyrl54t7.jsn']', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:40.979Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "filesystem" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:41.066Z cpu2:70328)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:44.654Z cpu7:65675)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:44.654Z cpu7:65675)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:44.654Z cpu4:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:44.654Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:44.654Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:44.666Z cpu4:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:44.669Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:44.670Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500a8bd00) 0x28, CmdSN 0x8 from world 70328 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:44.705Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "vmfs" "extent" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:44.777Z cpu2:70330)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:06:48.365Z cpu7:65648)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:06:48.365Z cpu7:65648)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:06:48.365Z cpu4:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:06:48.365Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:06:48.365Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:06:48.377Z cpu4:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:06:48.380Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:06:48.380Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500adcf80) 0x28, CmdSN 0x8 from world 70330 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:06:48.389Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "core" "device" "partition" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:48.456Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "core" "device" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:48.571Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "nmp" "device" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:48.672Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "nmp" "device" "list" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:48.756Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "core" "device" "list" "--exclude-offline" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:48.866Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "core" "device" "list" "--exclude-offline" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:48.975Z INFO runcommand called with: args = '/sbin/localcli --formatter python "storage" "core" "device" "list" "--exclude-offline" 2>/dev/null', outfile = 'None', returnoutput = 'True', timeout = '0.0'.
2018-12-24T12:06:56.335Z cpu1:65999)NMP: nmp_ResetDeviceLogThrottling:3348: last error status from device t10.ATA_____Samsung_SSD_850_EVO_500GB_______________S2R9NX0J405834N_____ repeated 30 times
2018-12-24T12:07:00.236Z cpu4:70501)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:07:03.831Z cpu7:66739)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:07:03.831Z cpu7:66739)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:07:03.831Z cpu4:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:07:03.831Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:07:03.831Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x6
2018-12-24T12:07:03.844Z cpu4:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:07:03.847Z cpu4:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 2 commands
2018-12-24T12:07:03.847Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500b2bf00) 0x28, CmdSN 0x8 from world 70501 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:07:03.847Z cpu7:65568)ScsiDeviceIO: 2962: Cmd(0x439500b92c00) 0x28, CmdSN 0xf77 from world 0 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
2018-12-24T12:07:03.847Z cpu0:70540)Partition: 427: Failed read for "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU": I/O error
2018-12-24T12:07:03.847Z cpu0:70540)Partition: 1007: Failed to read protective mbr on "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" : I/O error
2018-12-24T12:07:03.847Z cpu0:70540)WARNING: Partition: 1158: Partition table read from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU failed: I/O error
2018-12-24T12:07:05.620Z cpu5:65566)NMP: nmp_ThrottleLogForDevice:3563: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 6 times
2018-12-24T12:07:05.620Z cpu5:65566)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x9e (0x439500ab3a00, 0) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x2 D:0x0 P:0x0 Invalid sense da$
2018-12-24T12:07:05.620Z cpu5:65566)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" state in doubt; requested fast path state update...
2018-12-24T12:07:05.620Z cpu5:65566)ScsiDeviceIO: 2927: Cmd(0x439500ab3a00) 0x9e, CmdSN 0xfa9 from world 0 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x2 D:0x0 P:0x0 Invalid sense data: 0x65 0x20 0x75.
2018-12-24T12:07:05.666Z cpu0:70611)WARNING: FreeBSDCharIoctl:1778: ioctl failed: dev = usb0103, cmd = 0x8004550f, err = -1: Failure
2018-12-24T12:07:05.667Z cpu0:70611)WARNING: FreeBSDCharIoctl:1778: ioctl failed: dev = usb0103, cmd = 0x8004550f, err = -1: Failure
2018-12-24T12:07:05.668Z cpu0:70611)WARNING: udev_submit_urb:1555: usbd_do_request_flag error USB_ERR_STALLED: Broken pipe
2018-12-24T12:07:05.669Z cpu0:70611)WARNING: udev_submit_urb:1555: usbd_do_request_flag error USB_ERR_STALLED: Broken pipe
2018-12-24T12:07:05.670Z cpu0:70611)WARNING: udev_submit_urb:1555: usbd_do_request_flag error USB_ERR_STALLED: Broken pipe
2018-12-24T12:07:05.690Z cpu0:70611)WARNING: udev_submit_urb:1555: usbd_do_request_flag error USB_ERR_STALLED: Broken pipe
2018-12-24T12:07:05.763Z cpu5:65566)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 10 times
2018-12-24T12:07:05.763Z cpu2:70611)WARNING: udev_submit_urb:1555: usbd_do_request_flag error USB_ERR_IOERROR: Failure
2018-12-24T12:07:06.047Z cpu7:65568)NMP: nmp_ThrottleLogForDevice:3546: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 20 times
2018-12-24T12:07:06.340Z cpu7:65568)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" state in doubt; requested fast path state update...
2018-12-24T12:07:06.588Z cpu6:70609)LVM: 4012: [t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU:1] Device expanded (actual size 3907029007 blocks, stored size 3907029001 blocks)
2018-12-24T12:07:10.175Z cpu3:65720)vmw_ahci[00000017]: CompletionBottomHalf:Error port=0, PxIS=0x40000008, PxTDF=0x4041
2018-12-24T12:07:10.175Z cpu3:65720)vmw_ahci[00000017]: LogExceptionSignal:Port 0, Signal: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|--|--|--|--|--|--|-- (0x0000)
2018-12-24T12:07:10.176Z cpu6:65949)vmw_ahci[00000017]: LogExceptionProcess:Port 0, Process: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020) Curr: --|--|--|--|--|TF|--|--|--|--|--|-- (0x0020)
2018-12-24T12:07:10.176Z cpu6:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:Performing device reset due to Task File Error.
2018-12-24T12:07:10.176Z cpu6:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:task file error on slot 0x1, activeTag 0x2
2018-12-24T12:07:10.188Z cpu6:65949)vmw_ahci[00000017]: _IssueComReset:Issueing comreset...
2018-12-24T12:07:10.191Z cpu6:65949)vmw_ahci[00000017]: ExceptionHandlerWorld:fail 1 commands
2018-12-24T12:07:10.191Z cpu3:65564)NMP: nmp_ThrottleLogForDevice:3563: last error status from device t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU repeated 36 times
2018-12-24T12:07:10.191Z cpu3:65564)NMP: nmp_ThrottleLogForDevice:3617: Cmd 0x28 (0x439500a75f00, 70609) to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $
2018-12-24T12:07:10.191Z cpu3:65564)ScsiDeviceIO: 2962: Cmd(0x439500a75f00) 0x28, CmdSN 0x8 from world 70609 to dev "t10.ATA_____WDC_WD20EFRX2D68EUZN0_________________________WD2DWCC4M6LY77TU" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x4 0x44 0x0.
hi
please post effect of this: esxcfg-volume -l
regards Przemek
did not show anything
just blank
[root@localhost:~] esxcfg-volume -l
[root@localhost:~]
For unknown reasons the size of the vmfs-volume is off by 3072 bytes = 6 sectors to what it is supposed to be.
Check the voma-screen.
That appears to be the only error according to voma - but I dont know wether voma stops at such a critical error ?
Anyway - the next thing you have to do is to adjust the partitionable by setting a new endsector for the vmfs-volume.
Stop all other experiments.
Ulli
I overlooked the I/O errors on the datastore during first read ....
I assume it will get worse soon and highly recommend to clone the complete 1.8 TB datastore with ddrescue
as long as that is still possible.
ESXi build in dd will probably already fail.
Thx u..
But because i need solve this soon as possible. I give up to make partition table healthy again.
What i can do is use 3rd recovery software, that can read vmfs also can extract vmdk. So i can copying file inside vmdk. For now its save my live
Thanks u guys, thanks to all of u.
We would like to hear what you actually used. ??
Ulli
i used recovery explorer