Skip navigation
VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
35,871 Views 81 Replies Last post: Jan 29, 2010 3:27 AM by anonimous RSS
CKitz Lurker 2 posts since
Dec 30, 2008
Currently Being Moderated
45. Feb 2, 2009 9:34 AM in response to: s1xth
Re: Moving VMs from one ESXi server to another - what a pain!!!

The FastSCP 3.0beta is out. I registered here and was able to download it right away.

 

The performance isn't that much better than regular scp though. Usually SCP gets me 2.5 - 3.2MB/s where this gets 4MB/s. My client is on Gigabit and my server is on 100Base-T.

s1xth Expert VMware Employees vExpert 744 posts since
Jul 29, 2008
Currently Being Moderated
48. Feb 2, 2009 10:53 AM in response to: ShahidSheikh
Re: Moving VMs from one ESXi server to another - what a pain!!!

Did you write a script for the snapshot part of the backup procedure? Just curious.

http://www.virtualizationimpact.com http://www.handsonvirtualization.com Twitter: @jfranconi
RenaudL Hot Shot VMware Employees 173 posts since
Sep 13, 2007
Currently Being Moderated
49. Feb 2, 2009 12:43 PM in response to: CKitz
Re: Moving VMs from one ESXi server to another - what a pain!!!

Here's a low-level explanation for the poor scp performance on ESXi:

 

When a ssh client & server start a file transfer, they negotiate behind-the-scene for the actual protocol to use for the copy: SCP or sFTP. SCP is the old legacy protocol (which the "scp" command name historically comes from), but sFTP is the protocol usually chosen if both peers support it (which is the case for most heavyweight ssh suites).

 

The ssh suite used in ESXi is dropbear which is perfect for embedded environments, but unfortunately doesn't support sFTP. Any scp transfer from/to ESXi will therefore rely on the SCP protocol, which has an extremely constraining window limitation of 2 I/O blocks (IIRC). This tiny window cripples the throughput and explains the bad numbers you all get.

 

We don't support file transfers over scp, but we do provide other efficient & supported tools to perform the same kind of operations. Don't ask me which, I'm not a GUI guy

s1xth Expert VMware Employees vExpert 744 posts since
Jul 29, 2008
Currently Being Moderated
50. Feb 2, 2009 4:24 PM in response to: RenaudL
Re: Moving VMs from one ESXi server to another - what a pain!!!

 

So what do you recommend for file transfers then? What other tools do you recommend using instead?

 

 

Just curious what does vmotion use? Or I should say, how does vmotion move the vm's faster?

 

 

http://www.virtualizationimpact.com http://www.handsonvirtualization.com Twitter: @jfranconi
s1xth Expert VMware Employees vExpert 744 posts since
Jul 29, 2008
Currently Being Moderated
53. Feb 2, 2009 5:14 PM in response to: ShahidSheikh
Re: Moving VMs from one ESXi server to another - what a pain!!!

Damn. I cant believe I never knew that. So if you have a bunch of ESX/ESXi servers that are using local storage, and you have VMOTION it wont work correct? You need to have your hosts on a SAN?

http://www.virtualizationimpact.com http://www.handsonvirtualization.com Twitter: @jfranconi
mcowger Champion User Moderators vExpert 3,635 posts since
Aug 22, 2007
Currently Being Moderated
54. Feb 2, 2009 5:18 PM in response to: s1xth
Re: Moving VMs from one ESXi server to another - what a pain!!!

Correct - the option wont be available.

 






--Matt

--Matt VCDX #52 blog.cowger.us
R-Sommer Enthusiast 101 posts since
Jul 21, 2008
Currently Being Moderated
55. Feb 3, 2009 2:13 AM in response to: s1xth
Re: Moving VMs from one ESXi server to another - what a pain!!!

 

I did a lot of tests and realized scp and rsync are rather slow, even rsync between to local SATA disks (about 6 MB/s IIRC). But using cp for all none vmdk files and vmkfstools -i for all vmdk files to copy them locally is acceptable for me (cp about 18 MB/s, vmkfstools about 35 MB/s). Therefore I'm pretty sure, that the limitation is on cpu or s.th. like this and not on network interface.

 

 

 

 

 

The next time I will make some test using iSCSI and NAS in comparison with local speed.

 

 

devzero Master 2,776 posts since
Dec 27, 2004
Currently Being Moderated
56. Mar 21, 2009 4:35 AM in response to: glim
Re: Moving VMs from one ESXi server to another - what a pain!!!
glim schrieb:

 

2. Enable unsupported sshd to your ESXi system.

 

 

3. Place this 'rsync-static-stripped' binary into /bin or somewhere else in your path on your ESXi system.

 

what about running rsync in daemon mode instead ? (-> http://rsync.samba.org/ftp/rsync/rsyncd.conf.html )

that should speed up things a LOT as the data doesn´t need to go trough sshd.....

kpc Enthusiast 114 posts since
Jul 12, 2006
Currently Being Moderated
57. Mar 21, 2009 4:39 AM in response to: devzero
Re: Moving VMs from one ESXi server to another - what a pain!!!

I'm on annual leave till the 31st March.  For urgent requests please contact Tony Ghirardi or Gavin Purnell.

 

--

This email and any accompanying document(s) contain information from Kent Police, which is confidential or privileged.

The information is intended to be for the exclusive use of the individual(s) or bodies to whom it is addressed.

If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of the contents of this information is prohibited.

If you have received this email in error, please notify us immediately by contacting the sender or telephoning 01622 690690.

The copyright in the contents of this email and any enclosure is the property of Kent Police and any unauthorised reproduction or disclosure is contrary to the provisions of the Copyright Designs and Patents Act 1998.

TechFan Enthusiast 117 posts since
Dec 12, 2006
Currently Being Moderated
58. Mar 21, 2009 6:19 AM in response to: devzero
Re: Moving VMs from one ESXi server to another - what a pain!!!

How would you run rsync in daemon mode on an ESXi box?  Rsync isn't

there. . .

devzero Master 2,776 posts since
Dec 27, 2004
Currently Being Moderated
59. Mar 21, 2009 8:00 AM in response to: TechFan
Re: Moving VMs from one ESXi server to another - what a pain!!!

sure - if you don`t copy it there, it won`t be there. as any other 3rd party tool.....

Bookmarked By (0)

Share This Page

Communities