I am using VMware ESXi and I am trying to setup a guest that is Windows 7 that will have an ATI Radeon video card passed through to it. I actually had this working on a previous system but I had to reinstall. Now when I do this the guest fails to start and I get the following:
Error message from localhost.XXXXXXXXXXX:
PCIPassthru 004:00.0: Guest tried to (null)map
32 device pages (with base address of 0xb5d20)
to a range occupied by main memory. This is
outside of the PCI Hole. Add pciHole.start =
"2909" to the configuration file and then power
on the VM.
error
12/23/2010 1:04:36 PM
media
User
When I do as it asks, the guest now starts but gets an immediate BSOD concerning memory management. Any ideas on why this is occuring and why it worked at one point but now it fails?
You can passthrough USB mouse/keyboard just fine in 5.0, the issue is only in 5.1 as an introduced bug. And you can passthrough multiple USB mice and keyboards as well, provided they are on different USB controllers. Using a USB PCIe card can help in this regards. But normally, most mainboards will come with 2 usb controllers, usually 1 for the rear and 1 for the front.
Also, if you are lacking PCIe slots, there are PCIe multipliers, internal or external, but they aren't exactly cheap. But it is an option. (I haven't tried them exactly because of their cost)
There are also PCIe extenders (cables) that can help you move away or even out the PCIe multiplier in case you need that (not enough spec in the rig or whatever)
So .. there are plenty of options to extend your VMs and their input/outputs. It all boils down to cost.
I don't think PCIe multipliers work correctly with VT-d, or at least there are very specific restrictions on what can be in between the card and the CPU for things to work properly.
About USB pass through, can you pass through any arbitrary USB device to a VM of choice? Or just keyboards/mice? I've got a Logitech DiNovo that behaves very strangely when attached to the passed through USB controller and I don't know what is to blame.
The PCIe multipliers come at some costs, besides money, like you cannot place devices that require a big number of lanes to funciton properly on a small PCIe. Like say 3 1x devices on a 1x slot. There is just no technical room for that.
On the other hand, GPUs do identify themselves as 2 devices, so from this point of view, we could assimilate PCIe multiplier to the same issues as GPU passthrough. So technically it should be possible, but practice will say which one indeed works fine and with what devices.
Regarding USB passthrough, I have no problems passing through any of my USB stuff: sticks, HDDs (both 3.5 powered or 2.5 non-powered), ps2 keybopard (with USB adapter) and USB mouse gone through a to_ps2 then to_usb adapters (I've got a KVM setup that uses ps2), a mustek video device used as a webcam, 2 USB hubs (1 not powered, 1 powered that also has audio and LAN going through and showing up as USB devices working fine), a video to USB device (as my GPU passthrough is not working; the new MB is scheduled to arrive from the US sometime in January),
I also connect to the USB my Canon IS3 for picture download, works fine as well.
Connecting my HTC tilt2 as storage works fine, for active sync something is not working right but I'm not sure if I actually installed all the needed stuff for it as I only use it as storage when connected.
I also got my lexmark printer connected through USB and working fine.
Yes, my main development machine is a VM on my ESXi 5.0, which is why I'm so USB driven ![]()
I would suggest looking at drivers maybe? If your DiNovo works fine during bios setup, I don't see any reason for its basic keys to not work fine passed through USB as-is.
Ohh, it seems like its me then who is having trouble with the USB devices.
If i put a device in like a keyboard or mouse, they dont show up in the list as a usb-device at all, so i cant even try to pass them trough.
If i put a more "complicated" device in, such as storage/webcam/hdd it shows up and passes trugh just right.
Does anyone of you know why i cant see a mouse/keyboard in the passtrough-usb list?
right now im solving it by passing trough the whole usb-Controller unit to the WM by using pci-passtrough
2012/12/3 ciuly <communities-emailer@vmware.com<mailto:communities-emailer@vmware.com>>
VMware Communities<http://communities.vmware.com/index.jspa>
VMDirectPath and ATI Radeon
reply from ciuly<http://communities.vmware.com/people/ciuly> in VMware ESXi™ 4 - View the full discussion<http://communities.vmware.com/message/2156944#2156944
as I'm mostly USB driven, I passed through both controllers to my dev machine and never needed any for the rest so I can't say how things are managed on my end. I find it weird somehow that you could passthrough different usb devices from the same controller to different VMs. Are you sure you are doing this?
USB issues is a low issue for me, I use a app on my iphone to simulate mouse/keyboard anyway
Guess its only an issue when fixing or the network is down
If I can pass through a microsoft MCE remote id also be happy
I really would like to be able to run 2, maybe even 3 media PCs from one box
The two boards I am curently looking at are:
ASRock Z77 Extreme4-M
ASRock H77 Pro4-M
Can see a few people have has success with these using ESXi 5.0
Any other suggestions here?
Also looking at a 2400s CPU simply for the fact it has a fairly low TDP and has VT-d support
Would rather double check everything before dropping £300-400 on a new machine!
I will admit the Asrock H77 Pro4-M is an Awesome board! It's the fastest one I've owned to date but there is one special thing to note it's a Mini ATX board so its short with only 3 PCI-e x8/16 slots and a PCI-E x1 slot "Covered with GPU". If your going for a small form factor I fully recommened this little guy. Its a very tight fit in a silverstone case it's less the 1cm from the power supply. It's given me no problems since I tossed it in the thread awhile back. The only thing I've done is add a much larger CPU heat sync and a slower fan. Went for a silent setup and have accomplished my goal.
To the guy asking about 3 monitors it comes down to what you want to spend the cheep ($100) little 7750 that's in mine will do 3 but that's not in a 3D gameing setup but will do general videos "1080p" not a problem. Its also nice in this setup as it dosent require additional power so it runs soley off the PCI-e 75watt power only.
For the USB as alot of people are asking its been said a few times... You Must pass the controller through you will not get single devices. I'm guessing it's something to go with hardware/memory mapping for the exact name of the function.
As far as using an AMD setup I have a strange feeling it will work with almost anything build it the last year... After all ATI-AMD video cards seem to work that's telling me that AMD has put a considerable amount of time into passthrough but thats just a guess as I havent used and AMD CPU since the first gen Opteron's.
Finding a motherboard with more slots and is working with GPU pass through is a bit of a challenge though.
Also when you say "Covered with GPU" is that if you have a fairly heafty graphics card? I have some small 5450s which you can quite easily fit another card close to
Nope any duel slot card will cover it. The GPU I have is considerd a single slot but the fan still covers. It's kind of a bummer I really wouldnt mind using the 1x slot for a NIC.
If the 5450 fits in a single slot you'll be good. So anything will the old style fan's "skinny" will be good to go.
Have you got DXVA working?
This is a big one for me as with 1080p content trying to play it without it really is a no go
Think my bank account is about to be damaged by the looks of things though ![]()
Well the Gigabyte board has 4 PCIE slots, im running it and some other people here as well are running it. (It's an AMD board)
Altough i had a problem with the 5450GPU, i have 2other ATI cards working simultaniously in passtrough, i dont think that 2more should be a problem...
Gigabyte GA990FXA-UD3
2012/12/3 x1nick <communities-emailer@vmware.com<mailto:communities-emailer@vmware.com>>
VMware Communities<http://communities.vmware.com/index.jspa>
VMDirectPath and ATI Radeon
reply from x1nick<http://communities.vmware.com/people/x1nick> in VMware ESXi™ 4 - View the full discussion<http://communities.vmware.com/message/2157236#2157236
Quite tempted by that, board is about the same price as the asrock one, but you can pick up a fx6100 chip significantly cheaper than a i5 chip!
What graphics cards are you running?
Yup works for me. There are some people in early parts with older cards say that it didnt work. With the 7 series and some of the 6 series there's been several good results.
All said it done I've spent $600 with re-useing some of the older hardware. Case, power, 2xNICS, Storage "4 SSD's".
Just looking at the Gigabyte GA990FXA-UD3
As it dosent have onboard graphics, does this mean you need to have a graphics card just for ESXi? I seem to remember ESXi always required its own graphics?
About the Gigabyte 990FXA
ESXI, doesnt require it's own gpu, you can passtrugh the GPU thats running the console. but you have to keep in mind that you wont be able to get back to the console without a reboot. But it's not that often youre using the console anyway..
About DXVA, im not really sure howto test it? im running my setuop as a htpc now, but im only watching 720p, and thats not a problem...
2012/12/3 x1nick <communities-emailer@vmware.com<mailto:communities-emailer@vmware.com>>
VMware Communities<http://communities.vmware.com/index.jspa>
VMDirectPath and ATI Radeon
reply from x1nick<http://communities.vmware.com/people/x1nick> in VMware ESXi™ 4 - View the full discussion<http://communities.vmware.com/message/2157246#2157246
Ah didnt know that
To test I usually play the video and monitor CPU usage
For me playing a 1080p x264 video CPU usage will typically be below 5% sometimes spiking to 10%
Without dxva will easily hit 95%+ on my E6600 C2D cpu
I will try to test it, but i have a ATI radeon 3870, and i really dont know if that supports DXVA from start?
And another ATI radeon card even older then 3870. that i dont remember the modell name on..
I think its nice to use old parts, so i usually buy used stuff pretty cheap..
Except for Ram and Motherboard everything in my ESXI server is used parts, that i bought second hand...
Alotugh it wasnt to smart to buy a SSD second hand as it crasched on me a couple of weeks ago...
2012/12/3 x1nick <communities-emailer@vmware.com<mailto:communities-emailer@vmware.com>>
VMware Communities<http://communities.vmware.com/index.jspa>
VMDirectPath and ATI Radeon
reply from x1nick<http://communities.vmware.com/people/x1nick> in VMware ESXi™ 4 - View the full discussion<http://communities.vmware.com/message/2157282#2157282
I've got a 7750 XFX that is a definite single card solution, and has worked fine for me. I've got a raid card in the next slot right next to it.
My 7750 works fine with DXVA, it is single slot, and 90 bucks after rebate right now - practically free ![]()
http://www.newegg.com/Product/Product.aspx?Item=N82E16814150612&Tpk=xfx%207750
I question for the guys running the Gigabyte GA990FXA-UD3 or Gigabyte GA990FXA-UD5 is the on board nic and any of the on board sata supported in Esxi 5.0 by default and if not did anyone manage to get drivers working? Also can you pass though the on board sata controllers on that board? I just want to run one SSD into esxi and i want to pass through the other controllers and drives if possible to get max speed in my NAS VM. Also is there more than 1 usb controller as i was hoping to run a media pc and a desktop pc as Vms so need 2 keyboards and 1 mouse. My media pc will be openElec hopefully and i have an infrared to usb converter that works so much better than normal IR for controlling media pcs.
Also someone mentioned you can pass through the graphics card running the VM console! just wondering if i stop the VM using that graphics card would it flip back to the console or not. Also has anyone ever found a way to pass through the hdmi from one graphics card to one VM and the vga and dvi to another? I know it is prob not possible but i am trying to get 3 displays over DVI for my desktop without a high power using card or a $300 card if i can help it. Lastly if you put a vm to sleep can you start up another VM while the other one is a sleep that uses the same cards that was passedthrough to the one i put to sleep? Wanted to have a few VM's for my desktop so i could switch between windows7, 8 and linux.
Also just wanted to say thanks for all the help so far! Been a long time since i came across such a great group of people helping everyone and even answering stupid questions without complaints ![]()
Also to the other person looking for a lot of PCIe slots have a look at the Gigabyte GA990FXA-UD5 that thing has 2x16, 1x8, 2x4, 1x1 and a pcie. THat is what i am looking at using.
