VMware Cloud Community
blueboy76
Contributor
Contributor

VMWare ESXI5.1 not support PCIE plx8632 switch transmit transparently to VM with passthrough feature in our pcie device card.

VMWare ESXI5.1 not support PCIE plx8632 switch transmit transparently to VM with passthrough feature in our pcie device card. Though other pcie device,such intel net card pasthrough is ok. When configure according to materials like other successful case,When finished,startup the VM.The error appear: “a general system error”; I ssh to the ESXi and execute "dmesg".Below it log output

2013-02-24T07:14:20.882Z cpu12:6547)WARNING: VMKPCIPassthru: 1380: Detected transaction pending on device 0b:00.0 after reset
2013-02-24T07:14:20.882Z cpu12:6547)VSCSI: 6335: handle 8192(vscsi0:0):Destroying Device for world 6601 (pendCom 0)
2013-02-24T07:14:20.909Z cpu2:4148)WARNING: VMKPCIPassthru: 1349: Reporting transaction pending on device 0b:00.0
2013-02-24T07:14:22.012Z cpu2:4148)WARNING: VMKPCIPassthru: 1380: Detected transaction pending on device 0b:00.0 after reset
2013-02-24T07:14:22.012Z cpu2:4148)WARNING: IOMMU: 1402: Unable to unset device 0b:00.0 since it hasn't been set.
2013-02-24T07:14:22.434Z cpu2:5048)Config: 347: "SIOControlFlag2" = 0, Old Value: 1, (Status: 0x0)
2013-02-24T07:14:41.651Z cpu18:6612)WARNING: UserLinux: 1331: unsupported: (void)

Need Vmware FE ‘s support and confirm the error reason .Or should we provide more log or picutre??

attachment is tar.gz by execute "vm--support" to produce

0 Kudos
6 Replies
blueboy76
Contributor
Contributor

by the way,the pcie switch support ACS.below is log.

I add the picuture about the pcie toplogy and configuration.

Any experts can tell me some clues about this?

0:00:00:05.621 cpu0:4096)Device: 527: Registered device: p=0x410012580630 0x41000ffc9dd0 00:0b:00.0 104c:b800 0000:0001 bd=0x410012eb30f0
0:00:00:05.621 cpu0:4096)VMK_PCI: 317: device 00:0b:00.0 event: Device inserted: new owner module
0:00:00:05.621 cpu0:4096)Device: 196: Found driver pci for device 0x410012580630   
0:00:00:05.621 cpu0:4096)PCI: 6344: 07:06.0: PCIe v2 PCI Express downstream switch port                                                 
0:00:00:05.621 cpu0:4096)PCI: 5327: 00:07:06.0: Found Device Serial Number support                
0:00:00:05.621 cpu0:4096)PCI: 5327: 00:07:06.0: Found Advanced Error Reporting support
0:00:00:05.621 cpu0:4096)PCI: 5327: 00:07:06.0: Found Virtual Channel support                                                           
0:00:00:05.621 cpu0:4096)PCI: 5327: 00:07:06.0: Found Enhanced Access Control support             
0:00:00:05.621 cpu0:4096)PCI: 5327: 00:07:06.0: Found Vendor Specific support        
0:00:00:05.621 cpu0:4096)PCI: 6277: 07:06.0: PCIe v2 PCI Express downstream switch port      
0:00:00:05.621 cpu0:4096)PCI: 6286: ACS capable device

0 Kudos
zXi_Gamer
Virtuoso
Virtuoso

OMG. please remove the vm-support file FIRST from the communities. It is open invitiation for miscreants to misuse.

0 Kudos
blueboy76
Contributor
Contributor

Thanks for your reminding.

It is just a test machine in internal net with evaluation version.

So ,it is absolutely open to everyone

0 Kudos
zXi_Gamer
Virtuoso
Virtuoso

VM with passthrough feature in our pcie device card.

Can you let me know what is this PCIe device card that you have given PT to the VM?

0 Kudos
blueboy76
Contributor
Contributor

share with everybody:

so both passthru and graphics device have SBIOS requirement to limit MMIO addresses to 42-bits.

I get the answer from VMware support today.

the pci card is TI dsp.

below is log:

2013-02-17T12:20:07.184Z| vmx| I120: PCIPassthru: 0b:00.0 : Device BAR 2 requested 64-bit memory address that exceeded MPN type (66038343401472).

2013-02-17T12:20:07.184Z| vmx| I120: PCIPassthru: 0b:00.0 : Device BAR 4 requested 64-bit memory address that exceeded MPN type (66037269659648).

2013-02-17T12:20:07.184Z| vmx| I120: Module DevicePowerOn power on failed.

In fact ,I change another 32 bit pci card to limit the bios pci address below 42.but the esxi crashed with purple screen.

I want to know whether there is a lot of limit about the pcie passthrough ?

first ,ACS for switch

second,bios enable vt-d,vt

other requirements such as 6 pcie at most,..........?

0 Kudos
zXi_Gamer
Virtuoso
Virtuoso

In fact ,I change another 32 bit pci card to limit the bios pci address below 42.but the esxi crashed with purple screen.

This kb answers that question.

0 Kudos