VMware Cloud Community
csmuc
Contributor
Contributor

Upgraded ESXi 5.0 to 6.5 - USB-disks not shown in VMs

Hi VMWare community,

I recently upgraded a stand alone ESXi from 5.0 to 6.5 (Build 7967591).

On the host, there are several guests, mainly Windows 2012 R2. After upgrading, the connected USB-disks are not being shown any more.

I cannot add a USB-disk to an existing VM any more.

Same with newly generated guests: I just installed a Windows 2016 Standard on the host, tried to add an USB-disk - no success.

ESXi sees the disks:

[root@server01:~] lsusb

Bus 002 Device 006: ID 1058:107c Western Digital Technologies, Inc. Elements Desktop (WDBWLG)

Bus 002 Device 005: ID 1058:107c Western Digital Technologies, Inc. Elements Desktop (WDBWLG)

Bus 002 Device 004: ID 1058:1230 Western Digital Technologies, Inc. My Book (WDBFJK)

Bus 001 Device 007: ID 0624:0252 Avocent Corp.

Bus 001 Device 006: ID 0624:0251 Avocent Corp. Virtual Mass Storage

Bus 001 Device 005: ID 0624:0249 Avocent Corp. Virtual Keyboard/Mouse

Bus 001 Device 004: ID 413c:a001 Dell Computer Corp. Hub

Bus 002 Device 003: ID 04d9:1603 Holtek Semiconductor, Inc. Keyboard

Bus 001 Device 003: ID 413c:a101 Dell Computer Corp.

Bus 002 Device 002: ID 8087:0024 Intel Corp. Integrated Rate Matching Hub

Bus 001 Device 002: ID 8087:0024 Intel Corp. Integrated Rate Matching Hub

Bus 002 Device 001: ID 0e0f:8002 VMware, Inc.

Bus 001 Device 001: ID 0e0f:8002 VMware, Inc.

I'd really appreciate any help on this issue.

Thanks in advance, best regards,

Christian

Reply
0 Kudos
13 Replies
Rsahi
Enthusiast
Enthusiast

Check to see if usb arbitrator service is on...

~ # /etc/init.d/usbarbitrator start | stop | status

chkconfig usbarbitrator on

This is used to let the usb device seen by the VMs

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

Would you please try this command on ESXi console and paste output here:

#esxcli hardware  usb passthrough device list

Thanks.

W

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

And yes, please check status of usbarbitrator service. If usbarbitrator is stopped then you cannot passthrough USB device to your VM.

But generally this service is auto start with system boot unless user deliberately disable it.

A

Reply
0 Kudos
Finikiez
Champion
Champion

I would start with moving to old usb drivers as ESXi 6.5 has new native usb driver

VMware Knowledge Base

Reply
0 Kudos
csmuc
Contributor
Contributor

Thanks for your replies!

Here's the result of the proposed commands:

[root@server01:~] /etc/init.d/usbarbitrator status

usbarbitrator is running

[root@server01:~] chkconfig usbarbitrator on

[root@server01:~] esxcli hardware usb passthrough device list

Bus  Dev  VendorId  ProductId  Enabled  Can Connect to VM          Name

---  ---  --------  ---------  -------  -------------------------  ----------------------------------

1    3    413c      a101         false  no (passthrough disabled)  Dell Computer Corp.

1    6    624       251           true  yes                        Avocent Corp. Virtual Mass Storage

Next step will be to switch back to the old USB driver. For this requires a reboot, I have to schedule a downtime first.

I'll post the results as soon as possible.

Thanks and best regards,

Christian

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

a

According to your output, the usbarbitrator service is up and running and the devices can be enumerated by host's driver. But your USB disks are not listed in passthrough device list.

Would you please try the commands below to get verbose info about the three USB disks?

You can try lsusb with "-s <BUSID:DEVICEID>" then according to your first post, they should be like this:

"lsusb -v -s 002:006"

"lsusb -v -s 002:005"

"lsusb -v -s 002:004"

Thanks

Reply
0 Kudos
csmuc
Contributor
Contributor

Sorry for replying that late. Attached the requested output:

Thanks once again!

[root@marserver01:~] lsusb -v -s 002:006

Bus 002 Device 006: ID 1058:107c Western Digital Technologies, Inc. Elements Desktop (WDBWLG)

Device Descriptor:

  bLength                18

  bDescriptorType         1

  bcdUSB               2.10

  bDeviceClass            0 (Defined at Interface level)

  bDeviceSubClass         0

  bDeviceProtocol         0

  bMaxPacketSize0        64

  idVendor           0x1058 Western Digital Technologies, Inc.

  idProduct          0x107c Elements Desktop (WDBWLG)

  bcdDevice           10.65

  iManufacturer           2 Western Digital

  iProduct                3 Elements 107C

  iSerial                 1 574343344532565A564B3735

  bNumConfigurations      1

  Configuration Descriptor:

    bLength                 9

    bDescriptorType         2

    wTotalLength           32

    bNumInterfaces          1

    bConfigurationValue     1

    iConfiguration          0

    bmAttributes         0xc0

      Self Powered

    MaxPower               26mA

    Interface Descriptor:

      bLength                 9

      bDescriptorType         4

      bInterfaceNumber        0

      bAlternateSetting       0

      bNumEndpoints           2

      bInterfaceClass         8 Mass Storage

      bInterfaceSubClass      6 SCSI

      bInterfaceProtocol     80 Bulk-Only

      iInterface              0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x81  EP 1 IN

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x02  EP 2 OUT

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

Binary Object Store Descriptor:

  bLength                 5

  bDescriptorType        15

  wTotalLength           22

  bNumDeviceCaps          2

  USB 2.0 Extension Device Capability:

    bLength                 7

    bDescriptorType        16

    bDevCapabilityType      2

    bmAttributes   0x0000f41e

      Link Power Management (LPM) Supported

  SuperSpeed USB Device Capability:

    bLength                10

    bDescriptorType        16

    bDevCapabilityType      3

    bmAttributes         0x00

    wSpeedsSupported   0x000e

      Device can operate at Full Speed (12Mbps)

      Device can operate at High Speed (480Mbps)

      Device can operate at SuperSpeed (5Gbps)

    bFunctionalitySupport   1

      Lowest fully-functional device speed is Full Speed (12Mbps)

    bU1DevExitLat          10 micro seconds

    bU2DevExitLat        2047 micro seconds

Device Status:     0x0001

  Self Powered

[root@marserver01:~] lsusb -v -s 002:005

Bus 002 Device 005: ID 1058:107c Western Digital Technologies, Inc. Elements Desktop (WDBWLG)

Device Descriptor:

  bLength                18

  bDescriptorType         1

  bcdUSB               2.10

  bDeviceClass            0 (Defined at Interface level)

  bDeviceSubClass         0

  bDeviceProtocol         0

  bMaxPacketSize0        64

  idVendor           0x1058 Western Digital Technologies, Inc.

  idProduct          0x107c Elements Desktop (WDBWLG)

  bcdDevice           10.65

  iManufacturer           2 Western Digital

  iProduct                3 Elements 107C

  iSerial                 1 574343344534554A5A345355

  bNumConfigurations      1

  Configuration Descriptor:

    bLength                 9

    bDescriptorType         2

    wTotalLength           32

    bNumInterfaces          1

    bConfigurationValue     1

    iConfiguration          0

    bmAttributes         0xc0

      Self Powered

    MaxPower               26mA

    Interface Descriptor:

      bLength                 9

      bDescriptorType         4

      bInterfaceNumber        0

      bAlternateSetting       0

      bNumEndpoints           2

      bInterfaceClass         8 Mass Storage

      bInterfaceSubClass      6 SCSI

      bInterfaceProtocol     80 Bulk-Only

      iInterface              0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x81  EP 1 IN

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x02  EP 2 OUT

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

Binary Object Store Descriptor:

  bLength                 5

  bDescriptorType        15

  wTotalLength           22

  bNumDeviceCaps          2

  USB 2.0 Extension Device Capability:

    bLength                 7

    bDescriptorType        16

    bDevCapabilityType      2

    bmAttributes   0x0000f41e

      Link Power Management (LPM) Supported

  SuperSpeed USB Device Capability:

    bLength                10

    bDescriptorType        16

    bDevCapabilityType      3

    bmAttributes         0x00

    wSpeedsSupported   0x000e

      Device can operate at Full Speed (12Mbps)

      Device can operate at High Speed (480Mbps)

      Device can operate at SuperSpeed (5Gbps)

    bFunctionalitySupport   1

      Lowest fully-functional device speed is Full Speed (12Mbps)

    bU1DevExitLat          10 micro seconds

    bU2DevExitLat        2047 micro seconds

Device Status:     0x0001

  Self Powered

[root@marserver01:~] lsusb -v -s 002:004

Bus 002 Device 004: ID 1058:1230 Western Digital Technologies, Inc. My Book (WDBFJK)

Device Descriptor:

  bLength                18

  bDescriptorType         1

  bcdUSB               2.10

  bDeviceClass            0 (Defined at Interface level)

  bDeviceSubClass         0

  bDeviceProtocol         0

  bMaxPacketSize0        64

  idVendor           0x1058 Western Digital Technologies, Inc.

  idProduct          0x1230 My Book (WDBFJK)

  bcdDevice           10.50

  iManufacturer           2 Western Digital

  iProduct                3 My Book 1230

  iSerial                 1 574343344531343638343036

  bNumConfigurations      1

  Configuration Descriptor:

    bLength                 9

    bDescriptorType         2

    wTotalLength           32

    bNumInterfaces          1

    bConfigurationValue     1

    iConfiguration          0

    bmAttributes         0xc0

      Self Powered

    MaxPower               26mA

    Interface Descriptor:

      bLength                 9

      bDescriptorType         4

      bInterfaceNumber        0

      bAlternateSetting       0

      bNumEndpoints           2

      bInterfaceClass         8 Mass Storage

      bInterfaceSubClass      6 SCSI

      bInterfaceProtocol     80 Bulk-Only

      iInterface              0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x81  EP 1 IN

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x02  EP 2 OUT

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

Binary Object Store Descriptor:

  bLength                 5

  bDescriptorType        15

  wTotalLength           22

  bNumDeviceCaps          2

  USB 2.0 Extension Device Capability:

    bLength                 7

    bDescriptorType        16

    bDevCapabilityType      2

    bmAttributes   0x0000f41e

      Link Power Management (LPM) Supported

  SuperSpeed USB Device Capability:

    bLength                10

    bDescriptorType        16

    bDevCapabilityType      3

    bmAttributes         0x00

    wSpeedsSupported   0x000e

      Device can operate at Full Speed (12Mbps)

      Device can operate at High Speed (480Mbps)

      Device can operate at SuperSpeed (5Gbps)

    bFunctionalitySupport   1

      Lowest fully-functional device speed is Full Speed (12Mbps)

    bU1DevExitLat          10 micro seconds

    bU2DevExitLat        2047 micro seconds

Device Status:     0x0001

  Self Powered

[root@server01:~] lsusb -v -s 002:006

Bus 002 Device 006: ID 1058:107c Western Digital Technologies, Inc. Elements Desktop (WDBWLG)

Device Descriptor:

  bLength                18

  bDescriptorType         1

  bcdUSB               2.10

  bDeviceClass            0 (Defined at Interface level)

  bDeviceSubClass         0

  bDeviceProtocol         0

  bMaxPacketSize0        64

  idVendor           0x1058 Western Digital Technologies, Inc.

  idProduct          0x107c Elements Desktop (WDBWLG)

  bcdDevice           10.65

  iManufacturer           2 Western Digital

  iProduct                3 Elements 107C

  iSerial                 1 574343344532565A564B3735

  bNumConfigurations      1

  Configuration Descriptor:

    bLength                 9

    bDescriptorType         2

    wTotalLength           32

    bNumInterfaces          1

    bConfigurationValue     1

    iConfiguration          0

    bmAttributes         0xc0

      Self Powered

    MaxPower               26mA

    Interface Descriptor:

      bLength                 9

      bDescriptorType         4

      bInterfaceNumber        0

      bAlternateSetting       0

      bNumEndpoints           2

      bInterfaceClass         8 Mass Storage

      bInterfaceSubClass      6 SCSI

      bInterfaceProtocol     80 Bulk-Only

      iInterface              0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x81  EP 1 IN

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x02  EP 2 OUT

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

Binary Object Store Descriptor:

  bLength                 5

  bDescriptorType        15

  wTotalLength           22

  bNumDeviceCaps          2

  USB 2.0 Extension Device Capability:

    bLength                 7

    bDescriptorType        16

    bDevCapabilityType      2

    bmAttributes   0x0000f41e

      Link Power Management (LPM) Supported

  SuperSpeed USB Device Capability:

    bLength                10

    bDescriptorType        16

    bDevCapabilityType      3

    bmAttributes         0x00

    wSpeedsSupported   0x000e

      Device can operate at Full Speed (12Mbps)

      Device can operate at High Speed (480Mbps)

      Device can operate at SuperSpeed (5Gbps)

    bFunctionalitySupport   1

      Lowest fully-functional device speed is Full Speed (12Mbps)

    bU1DevExitLat          10 micro seconds

    bU2DevExitLat        2047 micro seconds

Device Status:     0x0001

  Self Powered

[root@server01:~] lsusb -v -s 002:005

Bus 002 Device 005: ID 1058:107c Western Digital Technologies, Inc. Elements Desktop (WDBWLG)

Device Descriptor:

  bLength                18

  bDescriptorType         1

  bcdUSB               2.10

  bDeviceClass            0 (Defined at Interface level)

  bDeviceSubClass         0

  bDeviceProtocol         0

  bMaxPacketSize0        64

  idVendor           0x1058 Western Digital Technologies, Inc.

  idProduct          0x107c Elements Desktop (WDBWLG)

  bcdDevice           10.65

  iManufacturer           2 Western Digital

  iProduct                3 Elements 107C

  iSerial                 1 574343344534554A5A345355

  bNumConfigurations      1

  Configuration Descriptor:

    bLength                 9

    bDescriptorType         2

    wTotalLength           32

    bNumInterfaces          1

    bConfigurationValue     1

    iConfiguration          0

    bmAttributes         0xc0

      Self Powered

    MaxPower               26mA

    Interface Descriptor:

      bLength                 9

      bDescriptorType         4

      bInterfaceNumber        0

      bAlternateSetting       0

      bNumEndpoints           2

      bInterfaceClass         8 Mass Storage

      bInterfaceSubClass      6 SCSI

      bInterfaceProtocol     80 Bulk-Only

      iInterface              0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x81  EP 1 IN

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x02  EP 2 OUT

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

Binary Object Store Descriptor:

  bLength                 5

  bDescriptorType        15

  wTotalLength           22

  bNumDeviceCaps          2

  USB 2.0 Extension Device Capability:

    bLength                 7

    bDescriptorType        16

    bDevCapabilityType      2

    bmAttributes   0x0000f41e

      Link Power Management (LPM) Supported

  SuperSpeed USB Device Capability:

    bLength                10

    bDescriptorType        16

    bDevCapabilityType      3

    bmAttributes         0x00

    wSpeedsSupported   0x000e

      Device can operate at Full Speed (12Mbps)

      Device can operate at High Speed (480Mbps)

      Device can operate at SuperSpeed (5Gbps)

    bFunctionalitySupport   1

      Lowest fully-functional device speed is Full Speed (12Mbps)

    bU1DevExitLat          10 micro seconds

    bU2DevExitLat        2047 micro seconds

Device Status:     0x0001

  Self Powered

[root@server01:~] lsusb -v -s 002:004

Bus 002 Device 004: ID 1058:1230 Western Digital Technologies, Inc. My Book (WDBFJK)

Device Descriptor:

  bLength                18

  bDescriptorType         1

  bcdUSB               2.10

  bDeviceClass            0 (Defined at Interface level)

  bDeviceSubClass         0

  bDeviceProtocol         0

  bMaxPacketSize0        64

  idVendor           0x1058 Western Digital Technologies, Inc.

  idProduct          0x1230 My Book (WDBFJK)

  bcdDevice           10.50

  iManufacturer           2 Western Digital

  iProduct                3 My Book 1230

  iSerial                 1 574343344531343638343036

  bNumConfigurations      1

  Configuration Descriptor:

    bLength                 9

    bDescriptorType         2

    wTotalLength           32

    bNumInterfaces          1

    bConfigurationValue     1

    iConfiguration          0

    bmAttributes         0xc0

      Self Powered

    MaxPower               26mA

    Interface Descriptor:

      bLength                 9

      bDescriptorType         4

      bInterfaceNumber        0

      bAlternateSetting       0

      bNumEndpoints           2

      bInterfaceClass         8 Mass Storage

      bInterfaceSubClass      6 SCSI

      bInterfaceProtocol     80 Bulk-Only

      iInterface              0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x81  EP 1 IN

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

      Endpoint Descriptor:

        bLength                 7

        bDescriptorType         5

        bEndpointAddress     0x02  EP 2 OUT

        bmAttributes            2

          Transfer Type            Bulk

          Synch Type               None

          Usage Type               Data

        wMaxPacketSize     0x0200  1x 512 bytes

        bInterval               0

Binary Object Store Descriptor:

  bLength                 5

  bDescriptorType        15

  wTotalLength           22

  bNumDeviceCaps          2

  USB 2.0 Extension Device Capability:

    bLength                 7

    bDescriptorType        16

    bDevCapabilityType      2

    bmAttributes   0x0000f41e

      Link Power Management (LPM) Supported

  SuperSpeed USB Device Capability:

    bLength                10

    bDescriptorType        16

    bDevCapabilityType      3

    bmAttributes         0x00

    wSpeedsSupported   0x000e

      Device can operate at Full Speed (12Mbps)

      Device can operate at High Speed (480Mbps)

      Device can operate at SuperSpeed (5Gbps)

    bFunctionalitySupport   1

      Lowest fully-functional device speed is Full Speed (12Mbps)

    bU1DevExitLat          10 micro seconds

    bU2DevExitLat        2047 micro seconds

Device Status:     0x0001

  Self Powered

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

Hummmm, didn't find any abnormal info on device side. And never seen this kind of problem before.

So which model of server you are using? According to your info, I think you connect all these devices to onboard USB ports of the server right? And all of the USB ports on your server are USB2 ports. I'll try to repro this in my side and will let you know if I can reproduce it.

Reply
0 Kudos
csmuc
Contributor
Contributor

First of all: Thanks for helping on this issue.

The server is a Dell PowerEdge T420. All disks are connected to onboard USB ports of the server. I do not use any kind of USB hub

All of the server's USB ports are USB2.

I'd be glad, if you found a way to reproduce the issue. If not, I'll try to switch back to the old USB-driver.

Thanks once again and best regards,

Christian

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

Thanks Christian.

I tried today on my Dell T620 but I found direct upgrade is not supported from 5.0 to 6.5.

First I installed build 5.0GA 469512 then try to upgrade to 7967591 via iso installation. When proceeding to installation step I was told I cannot upgrade build from 5.1 or older releases to 6.5 release directly, that's not supported. Only install build options available. So would you please let me know how did you upgrade your server from 5.0 to 6.5? Thanks.

Reply
0 Kudos
csmuc
Contributor
Contributor

Hello,

I'm afraid, I put the wrong version number by mistake. I was upgrading a ESXi 5.5 to 6.5:

2018-04-20T15:13:44.840Z INFO   Found ESXi on t10.Dell____Internal_Dual_SD________0123456789AB: {esx : False; esxi : True; lopsided : None; version: (5, 5, 0)}.
2018-04-20T15:13:44.841Z DEBUG  Dialog: Raising screens for {esx : False; esxi : True; lopsided : None; version: (5, 5, 0)}.
2018-04-20T15:13:44.841Z DEBUG  Dialog: only esxi, no vmfs
2018-04-20T15:13:57.240Z DEBUGUser selected to "Upgrade".
2018-04-20T15:13:57.265Z DEBUGUser chose disk: t10.Dell____Internal_Dual_SD________0123456789AB to install to.

Sorry for that and thanks once again!

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

Sorry for reply late, I cannot made reply in these days. Not sure what's the problem here.

Then would you please share the steps how you upgrade your server from 5.5 to 6.5? Which build of ESXi5.5 you were using? And which virtual USB controller you configured on your VMs?

And would you please share output of "#cat /dev/usbdevices" in your ESXi6.5? Thanks.

Reply
0 Kudos
jUDASmILExAlmig
Enthusiast
Enthusiast

And some updates from my side. I think you may installed and upgraded your system in SD card on your Dell server. As there's no SD card in hand then I tried with an USB flash disk with intalled an ESXi 5.5 build and upgraded it to 6.5. Also I attached a WD USB HDD, not the same one as yours. After system upgrade I can found the device in usb device list and I can attach it to VM as well.

Reply
0 Kudos