VMware Cloud Community
cipacs
Contributor
Contributor
Jump to solution

ESXi 4 - RAID Issues - ASUS RS700-E6/RS4

I've dabbled with virtualization for a few years now, but must admit up front that I am new to the world of ESXi.

Our company is wanting to replace 4 aging servers with a new beefier setup running Windows Server 2008 Enterprise x64. After doing some research and referencing the ESXi 4 HCL listing, we deciding to pick up the following server off the HCL:

ASUS RS700-E6/RS4

2 x Intel Xeon E5520 Nehalem 2.26GHz LGA 1366

8 x CORSAIR 2GB 240-Pin DDR3 SDRAM DDR3 1333 ECC

3 x Western Digital RE3 WD1002FBYS 1TB 7200 RPM SATA 3.0Gb/s

The server hardware isn't bad. I know it's not the greatest, but it's more than enough to meet our needs.

So here's the issue: I can't seem to get the ESXi software to detect the RAID array that has been setup. I've tried using RAID 5/10 configurations, and for the life of me, cannot get the software to detect the hard drives as one singular disk. When the installer runs, it asks which one of the physical disks to install to, rather than install to the array. This is quite annoying, as we need this setup for redundancy (in the event of a tragic failure. The server uses the following controller tech:

SATA Controller:

Intel® ICH10R:

6 SATA2 300MB/s ports

Intel Matrix Storage (for Windows only)

(Support software RAID 0, 1, 10 & 5)

LSI® MegaRAID (for Linux/Windows)

(Support software RAID 0, 1, 10)

SAS Controller:

Optional:

ASUS PIKE 1064E 4-port SAS RAID card

Asus PIKE 1078 8-port SAS HW RAID card

Currently, I am using the built in software initiated RAID (onboard). Is it necessary to use Hardware RAID for proper detection?

Does anyone have experience with this?

Reply
0 Kudos
1 Solution

Accepted Solutions
wila
Immortal
Immortal
Jump to solution

{quote

Not that I wouldn't wish to take your word on this, but is there a document out there that confirms that Hardware level raid is required?

Not that i know, but everyone down here can confirm that there is NO software RAID support in ESX, it never has been supported.

It is already fortunate that you can even use your onboard ICH10 chipset controller.

Hardware RAID is expensive for a reason, it has an extra processor that offloads CPU. Software RAID uses your hosts CPU, a CPU you normally don't want to tax extra as you already need it for your virtual machines.

As for your Pike RAID card, it doesn't appear to be on the HCL, so I would say it is not supported.

Or wait, it looks like the Pike RAID card is a rebranded LSI controller with a 1064/1078 chipset which should work. However in your case I would make sure and get a confirmation from ASUS that it works with vSphere before ordering.

While you are at it, do get a Battery Backed Unit (BBU) with the controller as it makes a huge difference in performance as you can then enable the write back cache.



--

Wil

_____________________________________________________

VI-Toolkit & scripts wiki at http://www.vi-toolkit.com

edit: added note about LSI

| Author of Vimalin. The virtual machine Backup app for VMware Fusion, VMware Workstation and Player |
| More info at vimalin.com | Twitter @wilva

View solution in original post

Reply
0 Kudos
18 Replies
weinstein5
Immortal
Immortal
Jump to solution

Welcome to the Forums - Yes you will need to use the hardware RAID - ESXi can not use a software RAID -

If you find this or any other answer useful please consider awarding points by marking the answer correct or helpful

If you find this or any other answer useful please consider awarding points by marking the answer correct or helpful
cipacs
Contributor
Contributor
Jump to solution

I have looked through all of the documentation from VMWare that I could locate, but I couldn't find any specific requirements stating that hardware RAID was required. There appears to be a ASUS PIKE Raid card available for purchase but given it's price tag, I would like to confirm that it will indeed correct the issue before making the purchase.

Not that I wouldn't wish to take your word on this, but is there a document out there that confirms that Hardware level raid is required?

Reply
0 Kudos
wila
Immortal
Immortal
Jump to solution

{quote

Not that I wouldn't wish to take your word on this, but is there a document out there that confirms that Hardware level raid is required?

Not that i know, but everyone down here can confirm that there is NO software RAID support in ESX, it never has been supported.

It is already fortunate that you can even use your onboard ICH10 chipset controller.

Hardware RAID is expensive for a reason, it has an extra processor that offloads CPU. Software RAID uses your hosts CPU, a CPU you normally don't want to tax extra as you already need it for your virtual machines.

As for your Pike RAID card, it doesn't appear to be on the HCL, so I would say it is not supported.

Or wait, it looks like the Pike RAID card is a rebranded LSI controller with a 1064/1078 chipset which should work. However in your case I would make sure and get a confirmation from ASUS that it works with vSphere before ordering.

While you are at it, do get a Battery Backed Unit (BBU) with the controller as it makes a huge difference in performance as you can then enable the write back cache.



--

Wil

_____________________________________________________

VI-Toolkit & scripts wiki at http://www.vi-toolkit.com

edit: added note about LSI

| Author of Vimalin. The virtual machine Backup app for VMware Fusion, VMware Workstation and Player |
| More info at vimalin.com | Twitter @wilva
Reply
0 Kudos
cipacs
Contributor
Contributor
Jump to solution

I was really hoping that VMWare would have documented this as a requirement for using RAID before throwing $400 bucks at the Hardware RAID controller. Oh well.

Anyway, thank you everyone for the responses.

Reply
0 Kudos
Charadeur
Contributor
Contributor
Jump to solution

In all fairness they don't tell you what does not work. That list would never be complete. They tell you what does work on the HCL. Buy products listed there and you can't go wrong.

Reply
0 Kudos
DenisJones
Contributor
Contributor
Jump to solution

Otherway you can use Starwind`s iSCSI decision, it also offers RAID functionality. In my opinion it`s very robust and powerful tool.

Regards, Denis.

Reply
0 Kudos
cipacs
Contributor
Contributor
Jump to solution

The case design is a cable-less setup, and so using the Asus PIKE 1078 (which uses the "LSISAS1078" MegaRAID 1078 SAS Controller) is my best option. Because of the internal design, it would be difficult to run the cables and not interupt the airflow design.

I appreciate the feedback though.

I will be trying the Asus PIKE 1078 solution first, and if everything works accordingly, I'll do my best to update this thread, should someone else find it useful later on.

Reply
0 Kudos
wila
Immortal
Immortal
Jump to solution

Hmmm... interesting as you say the same thing in all your posts ... 11 posts and 11 about starwind iscsi... are you working for them?

If so, then it would be decent to add that bit of info to your reply as well.

PS: Not to rain on your parade (your input can be valuable to know)

The post was about local storage and your storage suggestion is about storage in the LAN which isn't the same thing as you would need an extra box for it.

It is also not starwind that supports the RAID drives, but the host operating system unless i'm not mistaken.



--

Wil

_____________________________________________________

VI-Toolkit & scripts wiki at http://www.vi-toolkit.com

| Author of Vimalin. The virtual machine Backup app for VMware Fusion, VMware Workstation and Player |
| More info at vimalin.com | Twitter @wilva
Reply
0 Kudos
DenisJones
Contributor
Contributor
Jump to solution

You know, if I would for it I wouldn`t scream in every post use Starwind! It`s cool! And it`s even is free, cause you needed only 11 posts to think that I`m a spam-bot )

And also: it`s of supported in ESX 4.0 storage controllers. I don`t know really why it`s so much shorter than for 3.5.

Reply
0 Kudos
wila
Immortal
Immortal
Jump to solution

Heheh, no worries, it stood out to me as i remembered reading your other replies, which probably says more about me as it does about you Smiley Wink

There's no harm done even if you would work for them, there are more vendor employees replying in these forums, but they normally add that bit of information.

In your case you are just an enthousiastic user and there's nothing wrong with that.



--

Wil

_____________________________________________________

VI-Toolkit & scripts wiki at http://www.vi-toolkit.com

| Author of Vimalin. The virtual machine Backup app for VMware Fusion, VMware Workstation and Player |
| More info at vimalin.com | Twitter @wilva
Reply
0 Kudos
DenisJones
Contributor
Contributor
Jump to solution

Ye, I like this tool. I found it accidentally, tried and found that this stuff just works! And if you are interested I work for one of hosting companies.

Oh, about employes of Starwind: as I know their evangelist is reading all communities all the time - just in case of any troubles with their software.

Reply
0 Kudos
cipacs
Contributor
Contributor
Jump to solution

I just wanted to update this request.

I purchased the "Asus PIKE 1078 8-port SAS HW RAID card" off of Newegg (), and it did the trick. The card is specifically designed as a Hardware RAID solution for the RS700-E6/RS4 Server, and after creating an array using the RAID GUI, ESXi detects the arrays themselves (and not just the individual drives).

Anyway, I thought others might find this useful in the future, and thank you everyone for your assistance.

Reply
0 Kudos
cbschuld
Contributor
Contributor
Jump to solution

cipacs:

Are you able to view the status and health statistics of the array?

Thanks!

Reply
0 Kudos
matos
Contributor
Contributor
Jump to solution

Do you use it with SAS hard disks ?

It works properly under ESX 4.0 (no IO errors) ?

Best regards

José Matos

Reply
0 Kudos
bbjedi
Contributor
Contributor
Jump to solution

If you are asking about the ASUS PIKE 1078 HW RAID Card, yes you can seen the health statistics of the Array. The PIKE 1078 uses the LSISAS1078 RAID chipset which provides CIM support unlike the Adaptec controllers. One key note about the PIKE 1078 is that there is no battery backup. This is extremely important if you would like to utilize the write back cache which will greatly improve performance with ESX. The real kicker is the documentation for the PIKE 1078 RAID controller on page 2-31 shows a battery backup up present. You will shell out about 400 bucks for the 1078 but is it really worth it with no battery backup. I would just get the lower end controller PIKE 1064E.

Here is the system I put together:

ASUS RS300-E6 with Intel 3420 PCH and Xeon 3440

6 KVR1066D3Q8R7S/4G for a total of 24GB. (No reason to buy the 1333 for the Lynnfield)

ASUS PIKE 1078 RAID controller

4 Western Digital RE3 WD1002FBYS. Supports RAID-specific, time-limited error recovery (TLER).

Note: With the latest line of WD Black drivers you cannot use WDTLER to reset the TLER. I tried with no go and WD confirmed they removed the ability so you have to purchase their RE3 class drivers. Smiley Sad

I configured the controller with the following settings. LSI provides some recommendations:

http://www.lsi.com/DistributionSystem/AssetDocument/MegaRAID_Perfomance_Tuning_and_Benchmark_Tips.pd...

RAID 10 (If you are thinking RAID 5 check out BAARF)

Stripe Size: 1024kb (to match my VMFS blocks)

Read Policy: Adaptive

Write Policy: Wthru

IO Policy: direct

Disk Cache Policy: enabled

I configured VMFS with multiple blocks with multiple LUNs using the following chart from http://kb.vmware.com/kb/1003565 Good info here also:

http://www.yellow-bricks.com/2009/05/14/block-sizes-and-growing-your-vmfs/

Reply
0 Kudos
LeCook
Contributor
Contributor
Jump to solution

bbjedi: Thank for the pertinent LSI info. You mention page 2-31 of the  1078 manual mentioning a battery for the BBU feature of the 1078 (BTW  the 1068 doesn't do RAID5). My docs have bios setup info on that page...  What version/filename of the PDF are you looking at?

Just got an ASUS Z8NA-D6 aiming at a ESX setup...
- OS: Onboard ICH10, 2x32GB SATA SSDs in RAID1
- DataStore:  3x2TB SATA in RAID5

Pricing for the PIKE 1078 is a couple of hundreds lower than equivalent 8 port 3ware adapter (+ BBU) but I *want* write-back cache using a BBU and still am not clear if there are versions of the 1078 that may have it.

Reply
0 Kudos
LeCook
Contributor
Contributor
Jump to solution

does the pike 1078 come with a BBU?

Reply
0 Kudos
SergeySP
Contributor
Contributor
Jump to solution

cipacs wrote:

I just wanted to update this request.

I purchased the "Asus PIKE 1078 8-port SAS HW RAID card" off of Newegg (http://www.newegg.com/Product/Product.aspx?Item=N82E16816110043), and it did the trick.  The card is specifically designed as a Hardware RAID solution for the RS700-E6/RS4 Server, and after creating an array using the RAID GUI, ESXi detects the arrays themselves (and not just the individual drives).

Anyway, I thought others might find this useful in the future, and thank you everyone for your assistance.

Driver for what OS you chose when you installed the Raid controller?

Red Hat® Enterprise Linux 3/4/5?
SUSE Linux Enterprise Server 8/9/10?

Reply
0 Kudos