VMware Cloud Community
gopherhockey
Contributor
Contributor

Low Cost ESX 3.5 System - Suggestions?

For training purposes, I would like to put together a Vmware ESX 3.5 compatible computer to use in a lab environment. Something that can still run 3-4 systems, but also something that is not expensive.

To test with Windows 2008 Hyper-V it took about $550 on newegg.com and I have a solid lab box that can run 4-5 systems easily. Plenty to train on and practice.

With Vmware ESX its more confusing. First, the dual-CPU requirement seems to force me into server class motherboards. I think there are some motherboards meant for home systems that could pull it off. My guess is it will have to be Intel EM64T compatible (in order to run 64-bit hosts) as I'm having a hard time finding dual-CPU mothersboard that run AMD Athlon X2 type processors (something in the $140 range per processor)

I figure someone here has had probably done the same. I have an old Dell server that can run ESX, but its huge, slow, only has 3GB ram and while it has dual CPU its not 64-bit compatible.

Has anyone been able to put together a dual-CPU system for at or around $600?

So far it looks like the majority of my training will remain on Hyper-V. A nice product actually. Good thing they support Single CPU.

Reply
0 Kudos
116 Replies
Virtual_Jazz
Contributor
Contributor

Ok, I was sort of wrong on the scsi thing. I had to set the controller up properly and now it sees all three disks.

The problem I am currently experiencing is that after the installation starts, it does not recognise or sees a mouse, then offers to install esx in text mode, and just freezes.

The sata controller on the MB is NVIDIA nForce 570 SLITM chipsets . Really not sure why it is stalling.

Asus M2N-SLI Deluxe, should work ok

Reply
0 Kudos
Erik_Zandboer
Expert
Expert

Hi,

Not being able to install graphically should pose no problem. Both text and graphical install is possible without a mouse. I would try to disconnect any not needed hardware, including SATA (I would disable it in BIOS). Just to get an initial install done. After that, test away... For now, I think you should try to minimize your devices and hopefully you'll end up disabling the one that caues the freeze...

Visit my blog at http://www.vmdamentals.com
Reply
0 Kudos
Virtual_Jazz
Contributor
Contributor

Given up trying to install this on my new box, couldnt get it working so reverted to an old KV2 Extreme (V1.0) . Installation progesses further, and the mice is recognised, and the SCSI disks are seen, But the system crashes once trying to reformat the disk and VMFS partitions.

Comes up with a bug check and stops the installation. Wont recognise my SATA cdrom, so have to install from USB stick. Thinking of getting an IDE drive (would this work?), and extra memory.

Not quite sure why vmware has made installation so difficult, or maybe I am just being a bit lazy . The KV2 Extreme (V1.0) is X64, but no VT, does that mean no vmotion, or I can not have X64 VM's?

Reply
0 Kudos
Erik_Zandboer
Expert
Expert

Hi,

Very strange. Haven't you simply tried to connect no mouse at all? Having a mouse in ESX is pretty useless anyway (apart from maybe the graphical installer).

On the other board, you have three SCSI disks, but when they are formatted the system crahses, or does ESX install now?

Not having SATA support is no surprise; the number of supported controllers is very limited. ESX should install on IDE, but you cannot format VMFS on IDE (which is needed for your VMs). So you'll end up needing SCSI anyway. And a system crash at this point? My bet is that a linux install (redhat or the like) will crash as well.

You could also give ESX 3i a try, boot from a stick... ??

VMware has not made the install difficult, it simply relies on having supported hardware. Do not expect an easy ride on a whitebox, it's possible, but there are no guarantees. I assure you, take hardware that is on the HCL and all will be fine. Problem is, you don't want that kind of hardware powered up next to your bed Smiley Wink

Visit my blog at http://www.vmdamentals.com
Reply
0 Kudos
Virtual_Jazz
Contributor
Contributor

It doesnt install at all, at least it ges well past the other board. I was having problems installing from my SATA Cdrom, cant understand how. It starts the installation loads some of the drivers then asks where you want to load the image from. I select CDRom, it tries to find the drivers, doesnt then gives you the option to select another locations to install from. I guessed the problem was with the cdrom, so I put the vmware image on a usb stick booted with the cdrom, and selected the USB drive as an alternative location. It then progress further, scaning for the mice and the video card and nic. After that is presents you with the option of installing the software and the available drives you have, and recommends partitions for the VMFS, which in this case is one of the 3 scsi disks. If you select the default and proceed, it comes up with the Bug check error, and halts installation.

Not quite sure how to get past this. The board is relatively old (2005), but support dual core 64, and is HT capable. I know there is no easy ride with this, and I am quite happy trying out things till I get it working, but not quite sure what else to get or do.

If I were to disbale the SCSI disks and install the software on an IDE drive 160Gb, would it give me the option later on to create VMFS partitions or is this a one time only thing. Would I be able to enable Vmotion if the MB is not VT enabled?

Thanks

Reply
0 Kudos
Erik_Zandboer
Expert
Expert

The CDROM drive is the problem I guess. Don't go for installs from USB sticks. Try and find an IDE CDROM instead, and do a "next-next-finish" install. I have seen this problem with certain servers (on the HCL!!!) where mounting an ISO to the remote management interface presents the exact same problem. It boots initially, and when it is all ready to go and install ESX it cannot find the (in my case emulated) CDROM drive. Very annoying. It appears to be a problem with the driver (or rather missing the driver) used to access the CDROM drive.

I have had ESX 3.5 running succesfully on a hyperthreading P4 (2.8GHz) mainboard without problems, so a mainboard from 2005 is not that old in my opinion Smiley Happy

Dig up an old IDE CDROM drive and you'll be fine I think!

Edit: Vmotion is only possible with at least two ESX hosts and shared storage (amongst other things!). VT has nothing to do with that. Vmotion is not within your grasp right now I think. The cheapest solution I have seen enabling vmotion is having three boxes, two with ESX and one having an NFS or iSCSI software solution... Much different (and more complicated) from your setup.

Visit my blog at http://www.vmdamentals.com
Reply
0 Kudos
Dave_Mishchenko
Immortal
Immortal

If you have an HTTP / FTP server on your network you can copy the files to it and then select that as your source when you get prompted by the install. As mentioned it a problem with 3.5 and happen on newer hardware as well as old.

Reply
0 Kudos
Virtual_Jazz
Contributor
Contributor

Dave and Erik,

Thanks a lot guys. The IDE Hard drive and CDRom did the trick. I finally got VMWare esx 3.5 installed. Yet to have it tested though, once done, would recommend as a potential whitebox on the cheap, well relatively.

I guess you got to manage the server from another pc, or am I expected to have a gui once it boots up?

Reply
0 Kudos
Erik_Zandboer
Expert
Expert

No GUI... Just a message like "Hi I'm your ESX server at address xxx.xxx.xxx.xxx please manage me from somewhere else" Smiley Happy

So yes, you should connect another machine in the same LAN, check for IP connectivity, then browse to your ESX server and download the VI client from there. Install it on your connecting machine, and use it to connect to ESX. Happy fiddling Smiley Happy

Visit my blog at http://www.vmdamentals.com
Reply
0 Kudos
Virtual_Jazz
Contributor
Contributor

OK, That is great. will use my laptop for that. So I guess I would need another box to try out vmotion, and external storage (iscsi). Well let me start with this first. Once again thanks

Reply
0 Kudos
Erik_Bussink
Hot Shot
Hot Shot

I was looking forward to having a really small and quiet ESX server for home. I have achieved this using the Shuttle SX38P2 Pro.

I have already been able to implement the ESXi 3.5 (Build 82664 Update 1), which was then remediated into a Build 94430. As the Shuttle SX38P2 Pro comes with a Marvell 88E8056 (Yukon)gigabit network card which is not recognized by either the ESX 3.5 nor the ESXi 3.5, I added a Quad-Gigabit NIC from HP, the HP NC364T. This gives me enough network connectivity for sc/vmotion/isci and virtual network. I used a simple ASUS 8500GT Silent graphic card. internal storage is two 1TB Hitachi disks.

Erik Bussink Solution Architect @VMware CISSP, VCP#67, RHCE, DCUCD
Reply
0 Kudos
Erik_Bussink
Hot Shot
Hot Shot

> Hi Erik,

>

> I read from your online posting about your experience of running VMware ESX on the Shuttle SX38P2 Pro. Your posting was most informative and helpful - and would like to thank you for posting up your experience online to share with the community.

>

> I am very keen to have a similar setup and am currently in the phase of gathering more information - would it be possible to ask you for

> some of your opinions and experience with the setup?

>

> I'm looking to having the VMware ESX running on the Shuttle SX38P2 Pro on SATA harddisks and would most probably be considering a HP NC360T PCIe dual-port card instead of your Quad-port card in order to reduce costs. Processor would likely be an Intel Core2Quad processor with a nvidia graphics card, likely to follow your specs since those are proven to work.

>

> The main considerations I have at this moment is the compatibility of VMware ESX for the following:

> - SATA harddisks (hardware compatibility doc doesn't mention the ICH9R chipset)

> - network adapter (you mentioned the onboard nic isn't recognised?)

>

> Is there any difference between using the ESX and ESX(i) versions?

>

> Any information you care to share is greatly appreciated!

> Thank you also for your time on this as well!

>

> Regards,

> dennis

Hiya Dennis,

ICH9R SATA Controller

You cannot use the RAID/AHCI feature of the ICH9R chipset to use the SATA drives in the SX38P2 Pro. You need to configure the BIOS as SATA Mode for IDE with Legacy support. The storage is not the fastest in this case, but it works good enough for a few VM (~9) running on ESXi 3.5. I have not been able yet to get ESX 3.5 to recognize the ICH9 Sata controller during the initial install (need to modify the pci config files etc...) and since I got ESXi 3.5 running, I stopped testing for now.

Network

The Marvel network card (88E8056) that is on the motherboard of the Shuttle SX38P2 Pro is not recognized. I knew that from the onset of my project. So I got the HP nc364t Quad Gigabit card and an HP nc360t Dual Gigabit card on my 2nd SX38P2 Pro. This allows me create a vSwitch with two uplinks for the Service Console, Vmotion and Virtual Machines, and keep on a separate vSwitch the iSCSI traffic.

The biggest challenge and bet, was to see if the motherboard, would recognize the PCIe 8x NIC in the PCIe 16x connector.

I took a Nvidia 8500GT Silent card, as I wanted a low-powered graphic card that could output a Dual-DVI link signal to drive my 30" monitor (2560x1600). You also need to make sure you have a 'thin' graphical card that does not take two slot spaces, otherwise you cannot plug-in you're nc360t.

The main difference between the ESXi (installable) and the ESX, is the service console. The ESXi doesn't have one, so I can't create scripts etc... but on another side, the ESXi doesn't require as much patching as the ESX.

CPU

I select the Xeon 3350 because I just could not get my hands on a Intel Q9450. The distributors in my area are out of stock for the last 3 months, and so the prices are way up. The Q9450 is nearly the double of the Xeon 3350.

BIOS

I have also select in the BIOS to stop the boot process on error setting : All erors, but Keyboard. So now Ican have the SX38Pro P2 as a ESXi appliance without keyboard & mouse. It's all managed from the VirtualCenter.

DPM

Thanks to the two HP nc364T and HP nc360T network cards, my system are now compliante with the Distributed Power Management. I can therefore poweroff half of my HA/DRS cluster and restart it when I need more performance.

I'm going to post this info also online on the forum, as I got a few request for infomation from other people as well. I hope that doesn't bother you.

Take care,

Erik

Message was edited by: Erik Bussink

More info on ICH9R settings, NIC, DPM

Erik Bussink Solution Architect @VMware CISSP, VCP#67, RHCE, DCUCD
Reply
0 Kudos
slh
Contributor
Contributor

Erik-

I purchased a shuttle case:

Shuttle P2 Chassis SP35P2V2 Intel Socket T(LGA775) Intel P35 4 x 240P

I have the same ICH9 chipset and Marvell onboard ethernet. I knew I had to replace the

ethernet card, how did you get the install to work? What did you have to go through?

Do you have step by step things that you did to get this working?

Thanks in advance

Stephen Hathorne

slh@protechtraining.com

Reply
0 Kudos
lukasware
Contributor
Contributor

I like the shuttle barebones too...I run a openfiler iSCSI server

on one and and an ESXi VM server (and 10 VMs) on another.

The E8400 $160 processor is the cheapest one that supports 64bit guests.

Shuttle K45 ($99) + E8400 ($160) + 1 1TB seagate SATA ($99)

+ 4GB DDR2 RAM ($32). integrated video and GigE = $392

Low power and low noise. I had a terrible experience with IDE

primary (too slow for words) and replaced with a SATA primary

and speed seems good. Despite that I thought the docs say

no VMs stored on the primary drive VMs on primary works fine.

Note that the E8400 is a 1333MHz FSB and requires the latest

K45 BIOS from Shuttle. Flash under MS-DOS only (not windows).

OpenFiler is not kidding: no shared storage on boot drive

The K48 cannot be used as it has no slots therefore no (VMware) enet.

Extra $120 gets the Shuttle SG31G2S that has 2 slots 1 PCI 1PCIe

and holds 4GB RAM and has the fancy "ICE Genie" cooler...

Of course you need an Intel gigE PCI card for $24 since as noted

the on-board Marvel is not supported (works great under OpenFiler though)

In regards to the Shuttle X38 mentioned versus the X48,

I opted for the X48 chipset because of the 2 PCIe 2.0 slots and 8GB

DDR3 support. I also got the quad intel PT PCIe NIC.

Maybe the X48 was a mistake ($100 more plus DDR3 is 2X $ DDR2).

NOTE Quad Ethernet boards are only supported under the oldest version

of the BIOS.

Could not wait for the X58 chipset with QPI (Q4 08). Also could not wait for

the seagate 1.5TB drives (oct) since $135/1TB (pcconnection)

was too good of a deal.

Status under ESXi update 3

Shuttle X48 works...use oldest BIOS if using Quad intel cards

Shuttle K45 works, use latest BIOS is using E8200/E8400 w/ 1333MHz FSB

Message was edited by: lukasware

Reply
0 Kudos
hw-man
Contributor
Contributor

Ich bin zur Zeit nicht im Hause.

(Bis einschließlich dem 18. September 2008)

GrußGeorg Kohlhas

Reply
0 Kudos
MauPicco
Contributor
Contributor

Hi,

I tried to install ESXi 3i on dc7700 160Gb SATA HD with no success!

Please give me some suggestion.

The problem appear to be the HD.

Thanks

Reply
0 Kudos
paulo_meireles

Hi,

Please make sure that, in BIOS, the SATA controller is in "Native" or "RAID" mode, not on "IDE" or "Legacy" mode.

Regards,

Paulo Meireles

Reply
0 Kudos
MauPicco
Contributor
Contributor

Hi,

I tried to set RAID mode in SATA controller configuration but with no result. The only options are IDE and RAID.

The message is always:

Unable to find supported device to write the VMware Server 3i 3.5.0 image to.

Any other suggestion?

regards

Maurizio

Reply
0 Kudos
paulo_meireles

I'm sorry, can't help you from here. But you may give a look here:

http://communities.vmware.com/message/833710#833710

I have a dc7700 running ESX 3.5, but it has an HP P400 controller...

Regards,

Paulo Meireles

Reply
0 Kudos
ginjawinja
Contributor
Contributor

I have a HP DC7700, but everytime i try to install ESX 3.5 U2 it says 'the installer was unable to find any supported network devices'.

The onboard NIC works fine in Windows.

Any suggestions greatly recieved!

Thanks

Reply
0 Kudos