That's a good guess Michael and I thought it was the PCI-E video card as well, but my system doesn't actually use the riser card, it just plugs straight into the PCI-E slot. But for good measure I tried a regular PCI video card, praying this was the issue, and it still hangs at the same spot. Ha! It was actually pretty funny, but I was glad to be able to rule that out as well.
But I think I may have actually found the problem, I downloaded the latest version of Dell's Server Assistant CD to see if I could get that going and then use it to install ESX 3.5, it's also Linux, and interestingly it went on to say the following:
Ready.
Uncompressing Linux... Ok, booting the kernel.
Booting the system, please wait...
Mounting the server assistant installation media...
Having problems mounting server assistant media.
There may be a problem with the media.
I'm not a Linux guy (wish I was), but I'm guessing it can't see the disk? Very interesting, I am only using one disk, a Seagate (ST3300655SS) 300 GB 15,000 RPM SAS drive. I tried attaching it directly to the SAS1068-IR integrated controller, and when that didn't work, I bought a controller that was on the HCL, an LSI 3041E, but it didn't like that either. And I tried just using a regular 500GB 7200 RPM SATA drive, but still the same thing. I must be missing something here.
Do I need to have at least 2, or 3 disks in a raid configuration? Is this drive maybe too fast, or it just plain doesn't see/support it? It see's it in the BIOS no problem, and I've tried making it the primary boot device and hitting F12 to then manually start the install CD, no love.
Is there a way in Linux that I can manually set the boot device or mount the media? This has to be the issue and would explain why it hangs immediately, it can't mount the install files to any media.