VMware Cloud Community
teknogroup
Contributor
Contributor

iSCSI issues with U4

I have two hosts upgraded to U4 showing serious issues with iSCSI LUNs (hosted on a EMC Celerra NS352).

Another host with U1 has no problem with same LUNs.

Creating a 1-GB test file with 'dd', produces a lot of errors in /var/log/vmkernel:

May 12 10:44:59 ladrone1 vmkernel: 5:20:55:32.027 cpu3:1071)LinSCSI: 3201: Abort failed for cmd with serial=2352, status=bad0001, retval=bad0001

May 12 10:44:59 ladrone1 vmkernel: 5:20:55:32.027 cpu9:1082)iSCSI: session 0x7603f90 sending mgmt 3018781 abort for itt 3018779 task 0x7601a10 cmnd 0x3ea35a00 cdb 0x2a to (5 0 0 39) at 50733205

May 12 10:45:04 ladrone1 vmkernel: 5:20:55:37.194 cpu3:1071)LinSCSI: 3201: Abort failed for cmd with serial=2351, status=bad0001, retval=bad0001

May 12 10:45:14 ladrone1 vmkernel: 5:20:55:47.010 cpu2:1081)iSCSI: session 0x7603f90 task mgmt 3018781 response timeout at 50734703

May 12 10:45:14 ladrone1 vmkernel: 5:20:55:47.010 cpu9:1082)iSCSI: session 0x7603f90 sending mgmt 3018782 abort task set to (5 0 0 39) at 50734703

May 12 10:45:24 ladrone1 vmkernel: 5:20:55:57.012 cpu2:1081)iSCSI: session 0x7603f90 task mgmt 3018782 response timeout at 50735703

May 12 10:45:24 ladrone1 vmkernel: 5:20:55:57.012 cpu9:1082)iSCSI: session 0x7603f90 sending mgmt 3018783 LUN reset to (5 0 0 39) at 50735703

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu3:1083)iSCSI: session 0x7603f90 mgmt response 0x1 for unknown itt 3018781, rtt 0

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu3:1083)iSCSI: session 0x7603f90 mgmt response 0x5 for unknown itt 3018782, rtt 0

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu3:1083)iSCSI: session 0x7603f90 LUN reset success for mgmt 3018783, itt 3018779, task 0x7601a10, cmnd 0x3ea35a00

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu3:1083)iSCSI: session 0x7603f90 LUN reset success recovering itt 3018779, task 0x7601a10, cmnd 0x3ea35a00

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu3:1083)iSCSI: session 0x7603f90 LUN reset success recovering itt 3018780, task 0x76010e0, cmnd 0x3ea37a80

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu9:1082)iSCSI: session 0x7603f90 (5 0 0 39) finished error recovery at 50737050

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu9:1033)StorageMonitor: 196: vmhba32:0:39:0 status = 0/5 0x0 0x0 0x0

May 12 10:45:37 ladrone1 vmkernel: 5:20:56:10.474 cpu9:1033)StorageMonitor: 196: vmhba32:0:39:0 status = 0/5 0x0 0x0 0x0

May 12 10:45:50 ladrone1 vmkernel: 5:20:56:23.005 cpu3:1083)iSCSI: session 0x7603f90 closed by target iSCSI-ESX-Office-1 at 50738302

May 12 10:45:50 ladrone1 vmkernel: 5:20:56:23.005 cpu3:1083)iSCSI: session 0x7603f90 to iSCSI-ESX-Office-1 dropped

May 12 10:45:50 ladrone1 vmkernel: 5:20:56:23.005 cpu3:1083)iSCSI: session 0x7603f90 to iSCSI-ESX-Office-1 waiting 2 seconds before next login attempt

May 12 10:45:51 ladrone1 vmkernel: 5:20:56:23.527 cpu3:1027)StorageMonitor: 196: vmhba32:0:39:0 status = 0/5 0x0 0x0 0x0

May 12 10:45:52 ladrone1 vmkernel: 5:20:56:25.006 cpu3:1083)iSCSI: bus 0 target 0 trying to establish session 0x7603f90 to portal 0, address 192.168.221.253 port 3260 group 1

May 12 10:45:52 ladrone1 vmkernel: 5:20:56:25.007 cpu3:1083)iSCSI: bus 0 target 0 established session 0x7603f90 #2415 to portal 0, address 192.168.221.253 port 3260 group 1, alias iSCSI-ESX-Office-1

May 12 10:45:52 ladrone1 vmkernel: 5:20:56:25.007 cpu3:1083)Initialize the reset lun framework for session 0x7603f90

May 12 10:45:53 ladrone1 vmkernel: 5:20:56:26.006 cpu3:1083)iSCSI: session 0x7603f90 recv_cmd 0x3ea35a00, cdb 0x16, status 0x2, response 0x0, senselen 32, key 06, ASC/ASCQ 29/03, itt 3018788 task 0x7601a10 to (5 0 0 39), iSCSI-ESX-Office-1

May 12 10:45:53 ladrone1 vmkernel: iSCSI: Sense f0000600 0000000a 00000000 290300c0

May 12 10:45:53 ladrone1 vmkernel: 5:20:56:26.006 cpu3:1027)StorageMonitor: 196: vmhba32:0:39:0 status = 2/0 0x6 0x29 0x3

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Supported VPD pages for vmhba32:C0:T0:L37 : 0x0 0x80 0x83

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Device id info for vmhba32:C0:T0:L37: 0x51 0x83 0x0 0x10 0x60 0x6 0x4 0x8c 0xf5 0x7d 0x64 0xcc 0xd3 0x35 0xa1 0x83 0xd6 0x3a 0xee 0x90

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Id for vmhba32:C0:T0:L37 0x45 0x4d 0x43 0x2d 0x43 0x65 0x6c 0x65 0x72 0x72 0x61 0x2d 0x69 0x53 0x43 0x53 0x49 0x2d 0x56 0x4c 0x55 0x2d 0x66 0x73 0x35 0x31 0x5f 0x54 0x31 0x5f 0x4c 0x55 0x4e 0x33 0x37 0x5f 0x43 0x4b 0x43 0x65 0x6c 0x65 0x72 0

May 12 10:45:53 ladrone1 vmkernel: x72

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Supported VPD pages for vmhba32:C0:T0:L38 : 0x0 0x80 0x83

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Device id info for vmhba32:C0:T0:L38: 0x51 0x83 0x0 0x10 0x60 0x6 0x4 0x8c 0x57 0x7d 0x65 0x73 0x7c 0x8a 0xa7 0xfb 0x1b 0xf3 0x89 0x3f

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Id for vmhba32:C0:T0:L38 0x45 0x4d 0x43 0x2d 0x43 0x65 0x6c 0x65 0x72 0x72 0x61 0x2d 0x69 0x53 0x43 0x53 0x49 0x2d 0x56 0x4c 0x55 0x2d 0x66 0x73 0x35 0x32 0x5f 0x54 0x31 0x5f 0x4c 0x55 0x4e 0x33 0x38 0x5f 0x43 0x4b 0x43 0x65 0x6c 0x65 0x72 0

May 12 10:45:53 ladrone1 vmkernel: x72

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Supported VPD pages for vmhba32:C0:T0:L39 : 0x0 0x80 0x83

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Device id info for vmhba32:C0:T0:L39: 0x51 0x83 0x0 0x10 0x60 0x6 0x4 0x8c 0x6d 0x91 0x1c 0xa8 0xff 0x9b 0x9c 0xf1 0xe6 0x2b 0xe2 0xb1

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Id for vmhba32:C0:T0:L39 0x45 0x4d 0x43 0x2d 0x43 0x65 0x6c 0x65 0x72 0x72 0x61 0x2d 0x69 0x53 0x43 0x53 0x49 0x2d 0x56 0x4c 0x55 0x2d 0x66 0x73 0x35 0x33 0x5f 0x54 0x31 0x5f 0x4c 0x55 0x4e 0x33 0x39 0x5f 0x43 0x4b 0x43 0x65 0x6c 0x65 0x72 0

May 12 10:45:53 ladrone1 vmkernel: x72

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Supported VPD pages for vmhba32:C0:T0:L40 : 0x0 0x80 0x83

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Device id info for vmhba32:C0:T0:L40: 0x51 0x83 0x0 0x10 0x60 0x6 0x4 0x8c 0x6a 0xe6 0xe4 0xaa 0x75 0x21 0x45 0x33 0xb6 0x47 0x3e 0xc

May 12 10:45:53 ladrone1 vmkernel: VMWARE SCSI Id: Id for vmhba32:C0:T0:L40 0x45 0x4d 0x43 0x2d 0x43 0x65 0x6c 0x65 0x72 0x72 0x61 0x2d 0x69 0x53 0x43 0x53 0x49 0x2d 0x56 0x4c 0x55 0x2d 0x66 0x73 0x35 0x34 0x5f 0x54 0x31 0x5f 0x4c 0x55 0x4e 0x34 0x30 0x5f 0x43 0x4b 0x43 0x65 0x6c 0x65 0x72 0

May 12 10:45:53 ladrone1 vmkernel: x72

May 12 10:45:53 ladrone1 vmkernel: 5:20:56:26.017 cpu4:1077)FS3: 5034: Waiting for timed-out heartbeat http://HB state abcdef02 offset 3784704 gen 457 stamp 507386015180 uuid 4a017989-d215dfd0-9a04-002219bb6747 jrnl <FB 119170> drv 4.31

May 12 10:45:53 ladrone1 vmkernel: 5:20:56:26.028 cpu7:1047)FS3: 4831: Reclaimed timed out heartbeat http://HB state abcdef02 offset 3784704 gen 457 stamp 507327026734 uuid 4a017989-d215dfd0-9a04-002219bb6747 jrnl <FB 119170> drv 4.31

I opened a service request with VMware but I had no further feedback three working days after initial response Smiley Sad

Reply
0 Kudos
1 Reply
AndreTheGiant
Immortal
Immortal

Have you tried to open an issue to EMC?

How is the iSCSI configuration, the vSwitch and the physical part.

Are you using a dedicated network for iSCSI?

Andre

**if you found this or any other answer useful please consider allocating points for helpful or correct answers

Andrew | http://about.me/amauro | http://vinfrastructure.it/ | @Andrea_Mauro
Reply
0 Kudos