configure multiple NICs

[mla_]

Hi,

I have ESX server configured with storage on OF server.

I have one 1Gb card on each server.

I purchased 2 :

HP NC7170 PCI-X Dual Gigabit Network Interface Adapter

Now I have an option to add 1 dual port card to each server.

So I will have 3 gigabit ports on each server.

What will be the right way for configuration.

I will appreciate links or explanation on this topic.

Thx.

[SuryaVMware]

Lot of things depends on how your ESX environment will be. If it is a single server. I would use one NIC for Service Console and VMkernel.

2 NICs for the VM Network with loadbalancing. Again in this case you will have to understand that the Service Console n/w will not have redundancy.

If you are placing this server in a ESX cluster(HA & DRS) I would recommand to install atleast 4-6 NICs in each of the ESX servers. so that you can put "Service Console" and "VMKernel" on one vSwitch with 2 NICs and put "VM Network" on another vSwitch with 2 NICs.

Hope this answered your question.

-Surya

[khughes]

Personally I would never leave the service console vulnrable to a single point of failure. I would take my chances and put it on the same network as my production boxes before there is a chance I lost all control of the host, especially as a stand alone.

The best configuration would probably be to utilize vlan tagging / 802.1q and put all the NICs on one vSwitch and go from there. Granted this isn't the most secure way but it is redundant and you wont lose control of your ESX host if you encounter a NIC failure.

• Kyle

[AllBlack]

I agree that it all depends on what you want to do.

How do you access your OF storage? Is this over ISCSI? If so dedicate one nic for ISCSI purposes. ISCSI should sit on its own network

I would use a dedicated one for your service console too. If you are planning to do vmotion down the line, use a seperate nic and network for that too.

In our cluster we also have a dedicated nic for data too. This port is trunked so we can use VLAN on the ESX box.

We have dual nics too so we are placing console and ISCSI on same chipset. vmotion and data trunk share another one.

And now we haven't even covered failover

[Texiwill · Accepted solution]

Hello,

Check out my Topology blogs at http://www.astroarch.com/wiki/index.php/Blog_Roll#Cisco_Subnet_-_Blue_Gears_-_Virtual_Networking specifically Blue Gears - 3 Physical NICs with VMware ESX.

Best regards,

Edward L. Haletky

VMware Communities User Moderator

====

Author of the book 'VMWare ESX Server in the Enterprise: Planning and Securing Virtualization Servers', Copyright 2008 Pearson Education.

Blue Gears and SearchVMware Pro Blogs: http://www.astroarch.com/wiki/index.php/Blog_Roll

Top Virtualization Security Links: http://www.astroarch.com/wiki/index.php/Top_Virtualization_Security_Links

[mla_]

Thanks for all answers.

Generally, I understand all suggestions, but don't have enough experience just to configure what is suggested.

Yesterday I received my dual cards and install them to the ESX box and to OF. Both are detected.

>How do you access your OF storage? Is this over ISCSI?

YES

> If so dedicate one nic for ISCSI purposes. ISCSI should sit on its own network

I have one subnet. Initially one card is used. Now I see 2 more cards. How I will proceed. Let say I will assign IP from differen subnet for iSCSI connection. Than I have to assign the IP from the same range to new ESX card? Also, can I bond 2 cards on OF and put IP from new range. And than team 2 cards on ESX? What are the hidden steps that could be necessar?

Yes, I would like to do VMotion (will add new ESX). ALL my setup is a testing LAB.

Sure, I have to read docs to clearly understand the steps but the desire to make it faster pushes to try without a lot of reading

[mla_]

Just read a blog.

Here is every thing I need.

Will ask question if something will be unclear.

Thanks.

[mla_]

By reading the blog I came to conclusion that in my situation (I build solid learning Lab) I will benefit if I will install 2 Dual NICs in my Real ESX server and will leave Open filer with one onboard 1Gb port.

This way I can practice NICs configuration.

I saw that max ammount of cards is 6. Is it a good idea to add one more card just to accomplish scenario with 6 NICs.

I have one onboard, two dual -1Gb.

Can 6th card be 100Mb let say for the console?

Is the whole idea about 6 physical ports is OK in my situation?

Thanks.

Michael.

[Texiwill]

Hello,

Can 6th card be 100Mb let say for the console?

Sure. Note that with 6 you will have VMotion and SC sharing the same vSwitch. If you do not worry about vMotion then 6 may not be the number you really need, but it will definitely not hurt. In this case I would make the 100 a failover device just in case of failure.

Is the whole idea about 6 physical ports is OK in my situation?

Yes.

1 for SC/1 for VMotion

2 for iSCSI

2 for VMs

Best regards,

Edward L. Haletky

VMware Communities User Moderator

====

Author of the book 'VMWare ESX Server in the Enterprise: Planning and Securing Virtualization Servers', Copyright 2008 Pearson Education.

Blue Gears and SearchVMware Pro Blogs: http://www.astroarch.com/wiki/index.php/Blog_Roll

Top Virtualization Security Links: http://www.astroarch.com/wiki/index.php/Top_Virtualization_Security_Links