VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
13 Replies Last post: Jun 30, 2009 9:05 AM by Texiwill  

ESXi as an internet frontier posted: Jun 9, 2009 12:18 PM

Click to view korba's profile Novice 18 posts since
Mar 11, 2009
What about such a stupid idea as installing ESXi on a server with 2 NIC's with one NIC sticking to the internet and the other one to the corporate LAN and running a router|proxy|firewall software in VM? Also including all the DMZ machines in virtual LAN? Is that extremly stupid or ita has a chance of success?

Re: ESXi as an internet frontier

1. Jun 9, 2009 12:29 PM in response to: korba
Click to view JohnADCO's profile Expert 245 posts since
Feb 9, 2009

You can run linux firewall VM's in ESX all day long, a ton of them, over commit like crazy. Not sure what else to say on it.

I am still attempting to grasp the usefullness of it though.

Re: ESXi as an internet frontier

2. Jun 9, 2009 4:49 PM in response to: korba
Click to view davidbarclay's profile Master 1,100 posts since
Sep 20, 2006

You certainly wouldn't be the first to use ESX as a hosting platform for firewalls/DMZ hosts.

Take a look at the Virtual Appliances, they have firewall configurations ready to go!

Dave

Re: ESXi as an internet frontier

3. Jun 9, 2009 9:04 PM in response to: davidbarclay
Click to view AndreTheGiant's profile Guru 5,942 posts since
Aug 28, 2008
Here is a VMware White Paper about DMZ virtualization with best practices:
http://www.vmware.com/files/pdf/dmz_virtualization_vmware_infra_wp.pdf

Andre
**if you found this or any other answer useful please consider allocating points for helpful or correct answers

Re: ESXi as an internet frontier

5. Jun 10, 2009 5:20 AM in response to: korba
Click to view AndreTheGiant's profile Guru 5,942 posts since
Aug 28, 2008
So how safe is ESXi by itself to be sticking out to the internet?

The vmkernel itself doen not have attack area.
Only the interface that have an IP could be attached.
So vmkernel port and management interface (or COS in ESX) must be protected with a firewall.

In ESX there is an integrated iptables firewall, but in ESXi there isn't.

Andre
**if you found this or any other answer useful please consider allocating points for helpful or correct answers

Re: ESXi as an internet frontier

6. Jun 16, 2009 8:55 AM in response to: AndreTheGiant
Click to view Texiwill's profile Guru 10,213 posts since
Jan 13, 2004
Hello,

Moved to Security Forum.

So how safe is ESXi by itself to be sticking out to the internet?

The vmkernel itself doen not have attack area.

Indirectly it does. A bunch of network services used for management... Those are actually running within the same space as the vmkernel using similar memory, etc. So while the 'footprint' may be different than ESX, the risk may be higher so protect your management and other vmkernel ports quite well.

Only the interface that have an IP could be attached.
So vmkernel port and management interface (or COS in ESX) must be protected with a firewall.

Absolutely.... YOu have 2 pNICs, get 2 more MINIMALLY..... for redundancy. 2 for the Management and 2 for VMs. You will need the bandwidth. The 2 Management ports or any management ports CAN NOT be internet facing. If they are you are AT RISK.

In ESX there is an integrated iptables firewall, but in ESXi there isn't.

Even so, the integrated iptables firewall is not configured to lock down by IP, MAC or anything of that nature. There are many services running within ESX/ESXi that need protection All used for management.


Best regards, Edward L. Haletky VMware Communities User Moderator, VMware vExpert 2009
Now Available on Rough-Cuts: 'VMware vSphere(TM) and Virtual Infrastructure Security: Securing ESX and the Virtual Environment'
Also available 'VMWare ESX Server in the Enterprise'
SearchVMware Pro|Blue Gears|Top Virtualization Security Links|Virtualization Security Round Table Podcast

Re: ESXi as an internet frontier

7. Jun 24, 2009 8:25 AM in response to: Texiwill
Click to view Brian Buchanan's profile Novice 19 posts since
Sep 17, 2007
I'm struggling with a similar question, an implementation of a remote branch with ESXi and I'd appreciate any insights.

I'm considering a "Fully Collapsed DMZ" with ESXi because I have limited resources for this branch, (only two servers and an iSCSI SAN) and my struggling point is with remote access to manage the ESXi server if the firewall appliances are not running. If the virtual firewalls are all up, then it's not a problem. But if those appliances are shutdown, fail to start or otherwise break, I can't figure out how I will remotely manage the ESXi to try and fix the problem.

I think that I have to place the service console/ management interface onto the internet.

The server's have 6 network interfaces each, Interconnect (for some day adding HA), LAN, Internet, SAN, Wireless, and another for whatever (currently connected to LAN). Is there something I could differently with those?

I've already decided that I trust HP, and so I plan to put the server's iLO interface on the Internet, so can I trust VMware in the same way and put the management interface on the Internet too?

Thanks for any thoughts.

Re: ESXi as an internet frontier

8. Jun 26, 2009 6:59 AM in response to: Brian Buchanan
Click to view Texiwill's profile Guru 10,213 posts since
Jan 13, 2004
Hello,

I've already decided that I trust HP, and so I plan to put the server's iLO interface on the Internet, so can I trust VMware in the same way and put the management interface on the Internet too?

Please do not do this. This is like leaving the door to your datacenter unlocked. Not a good idea.

I have a similar problem so I have a 'backdoor' of sorts. I use an external firewall that supports VPN technology and use that as the way to hop to the management tools as necessary. If my vFW fails I uise this other method to access the system using pre-shared keys.

Yes this does require an external device that handles VPN technology but it is really the only way. ESXi's management and HP ILOs should be behind a firewall at the very least. A 1U box running SMoothwall w/Zerina OpenVPN add on would satisfy your need.


Best regards, Edward L. Haletky VMware Communities User Moderator, VMware vExpert 2009
Now Available on Rough-Cuts: 'VMware vSphere(TM) and Virtual Infrastructure Security: Securing ESX and the Virtual Environment'
Also available 'VMWare ESX Server in the Enterprise'
SearchVMware Pro|Blue Gears|Top Virtualization Security Links|Virtualization Security Round Table Podcast

Re: ESXi as an internet frontier

9. Jun 26, 2009 7:25 AM in response to: Texiwill
Click to view Brian Buchanan's profile Novice 19 posts since
Sep 17, 2007

Drat. Not the answer I was hoping for, but thanks.

One of the reasons that I eventually decided to put the HP iLO on the net, was so that I could remotely power on the machine. If I use one of the servers as a firewall, and put the iLO behind it, I'll lose that ability.

I don't like the risk of losing control of a site that's a 4 hour flight away due to a `shutdown -h now` instead of a `shutdown -r now`, so I think my solution will have to bypass this issue entirely; I won't put these machines on the Internet. Instead of ordering an Internet connection, I'll order a private Point to Point connection.

Thanks for reinforcing how much of a bad idea this is.

Brian

Re: ESXi as an internet frontier

10. Jun 26, 2009 7:45 AM in response to: Brian Buchanan
Click to view hicksj's profile Master 1,243 posts since
May 6, 2005

Direct attached iLO & console is not the best idea, but there is an easy and fairly cheap work around as Ed mentioned.... You don't need anything fancy as firewall/vpn box in front. I think a $75 Linksys VPN Router would do the trick (BEFSX41). Certainly cost justifiable versus a 4-hr flight! :) This would only be used for the iLO/Console connections. All other services (prod firewall/applications/etc) would be hosted as you propose above.

Re: ESXi as an internet frontier

11. Jun 26, 2009 8:52 AM in response to: hicksj
Click to view Brian Buchanan's profile Novice 19 posts since
Sep 17, 2007
I thought that one too. I considered that the Linksys router was also offering a service(s) to the Internet (the VPN service at minimum); I decided that given a vulnerability in HP iLO and in a Linksys router, HP would be more likely to patch first.

I had to ask myself who do I trust? I considered that my HP ProLiant server is business class equipment that costs thousands of dollars, and a commercial router is consumer grade equipment that costs tens of dollars. My trust would go with HP.

I also considered defense in depth. I trust HP enough to put iLO on the net, so what if I add a consumer firewall as well? It couldn't hurt, right? Wrong. If the router had a new firmware (security patches for example) and being a consumer product, there's a great chance that the router's configuration will be wiped during the upgrade. I've seen it on 3Com and Netgear switches, I have some deployed that I can't upgrade because I would lose remote access to it, and I wouldn't be able to configure it back up. (you can probably tell that I run on a very limited budget)

If we were talking about HP ilO vs a $20,000 firewall with annual maintenance, then I would trust the firewall more. I would also expect upgrades to work flawlessly and not wipe configurations.

How often do you go looking for new firmware for a fleet of heterogeneous linksys/ cisco/ d-link consumer routers? How often do you download a new HP Firmware Maintenance CD that can patch up just about every server in your inventory?

I'm talking a lot about HP because I have thought a lot about that company, their development and I recognize the class of servers they produce. I'm still trying to decide how I feel about VMWare.

I honestly had to decide between RedHat XEN and VMWare ESXi and we had already paid for RedHat. I chose VMWare because VM is what VMWare does. Red Hat does a lot, (base distribution, GFS, Cluster, etc) and Xen is only one portion of what they support. Everything VMWare does (VMFS, vMotion, HA, DR) is solely to support a VM infrastructure. The Deployment of ESXi was extremely simple and straight forward. Configuration was more "what do I want' than "how do I do it". Red Hat XEN involved the installation of RHEL, securing it, then configuring of XEN, features of which weren't even working (maintaining a static host interface name (vifname) to a VM in particular)

I am thankful that I was able to choose ESXi because it was free. I will order for support and maybe someday move this two node, 4 processer deployment into a proper VMWare cluster, but not at the current costs of vSphere Enterprise. ($3K per processor is >> than free !). I might move to to vSphere Essentials Plus (HA/ DR) but it's still missing the incredible vMotion.

If I can trust VMware as I trust HP, then an ESXi Server console should be safe on the Internet. Wouldn't it rock VMware's world to have a vulnerability found in it? I just wish it had a bit more configurability; connections only accepted from certain IP ranges, intrusion detection and the ability to disable root while temporarily locking out other admin accounts on multiple password failures.

Yet, I still see the foolishness in putting the service console out on the net. If hacked, or the password guessed, not only would you lose the ESX server, but also every VM running on the box. Possibly even the entire cluster or the entire network. Well, now I realize the same could be said for HP's iLO. You could shut down the machine, boot up it a recovery mode, reset the root password and the attacker is in.

Thus my decision is to not even get an Internet connection. Instead I'll order a private point-to-point data connection (Frame Relay or MPLS or Hosted VPN or something) and connect the branch over that. I might still order an Internet connection, but it will be connected to a different NIC for only the VM's that need it.

Brian

Re: ESXi as an internet frontier

12. Jun 26, 2009 9:16 AM in response to: Texiwill
Click to view Brian Buchanan's profile Novice 19 posts since
Sep 17, 2007
Texiwill wrote:
Hello,

I've already decided that I trust HP, and so I plan to put the server's iLO interface on the Internet, so can I trust VMware in the same way and put the management interface on the Internet too?

Please do not do this. This is like leaving the door to your datacenter unlocked. Not a good idea.


I think your analogy broke down for me. After I thought about it, is it more like leaving the keys under the mat? The door is locked as much as the console is secure, but finding the key under the mat is like guessing/ brute forcing the root password (and that account doesn't lock out afaik).

That really drove home the point, making most of what I just wrote above kinda pointless. It looks secure, it feels secure, but it's not. A little work and your servers are not your own.

Thanks!

Brian

Re: ESXi as an internet frontier

13. Jun 30, 2009 9:06 AM in response to: Brian Buchanan
Click to view Texiwill's profile Guru 10,213 posts since
Jan 13, 2004
Hello,

Okay, you have a better analogy....

I use ILOs all the time and I have seen how unsafe they are. Remember they are first and foremost a remote access technology and NOT a security technology. I would use a security technology like the LinkSys VPN or something else as its designed to be a security technology.

ILO has several weaknesses that can be addressed by using pre-shared certificates and only allowing certain hosts/trusts so you can secure it, but if you can get in because these actions were not taken or there was another exploit found attackers have direct access to the console and could reboot your host as you wish to do. Use of a firewall make this less likely and possibly easier to control.

Remember the general rule: if someone can get CONSOLE access they can OWN the machine....


Best regards,
Edward L. Haletky VMware Communities User Moderator, VMware vExpert 2009, Virtualization Practice Analyst
Now Available: 'VMware vSphere(TM) and Virtual Infrastructure Security: Securing the Virtual Environment'
Also available 'VMWare ESX Server in the Enterprise'
SearchVMware Pro|Blue Gears|Top Virtualization Security Links|Virtualization Security Round Table Podcast

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities