The FastSCP 3.0beta is out. I registered here and was able to download it right away.
The performance isn't that much better than regular scp though. Usually SCP gets me 2.5 - 3.2MB/s where this gets 4MB/s. My client is on Gigabit and my server is on 100Base-T. 
The conslusion that I came to was with very limited reqources the best way to do this is to stick a 1 TB HD in a workstation and use it as an NFS export. If you are using Windows XP then you can use Services for Unix (SFU). performance is pretty reasonable with SFU.
Mount the NFS export as a datastore on both source and destination ESXi. Then you can either write a script to do the move for you or you can do it manually from SSH or VIC. Taking a snapshot and moving the snapshot first, then shutting down the VM and moving the delta can reduce downtime of the VM. Though you may have to do that from SSH.
Been able to utilize the gigabit link between ESXi and the XP machine to 200 mbps while copying that way.
Should also mention that at another client I used a similar scheme to backup VMs. They are strictly a windows shop and all their ESXi datastores are local RAID arrays on the servers themselves. I took the Windows XP machine that was running BackupExec with a 24 tape LTO-2 library connected to it, stuck a 1 TB HD in there and installed SFU on it. The ESXi machines dump a snapshot of the VMs on the 1 TB HD and BackupExec backs it up to tape.
Did you write a script for the snapshot part of the backup procedure? Just curious.
Here's a low-level explanation for the poor scp performance on ESXi:
When a ssh client & server start a file transfer, they negotiate behind-the-scene for the actual protocol to use for the copy: SCP or sFTP. SCP is the old legacy protocol (which the "scp" command name historically comes from), but sFTP is the protocol usually chosen if both peers support it (which is the case for most heavyweight ssh suites).
The ssh suite used in ESXi is dropbear which is perfect for embedded environments, but unfortunately doesn't support sFTP. Any scp transfer from/to ESXi will therefore rely on the SCP protocol, which has an extremely constraining window limitation of 2 I/O blocks (IIRC). This tiny window cripples the throughput and explains the bad numbers you all get.
We don't support file transfers over scp, but we do provide other efficient & supported tools to perform the same kind of operations. Don't ask me which, I'm not a GUI guy ![]()
So what do you recommend for file transfers then? What other tools do you recommend using instead?
Just curious what does vmotion use? Or I should say, how does vmotion move the vm's faster?
s1xth wrote:Did you write a script for the snapshot part of the backup procedure? Just curious.
Not yet but I plan to.
s1xth wrote:
Just curious what does vmotion use? Or I should say, how does vmotion move the vm's faster?
VMotion does not move the vmdk files. The vmdk files have to be on a centralized storage that is the datastore of both source and target ESX/ESXi.
Damn. I cant believe I never knew that. So if you have a bunch of ESX/ESXi servers that are using local storage, and you have VMOTION it wont work correct? You need to have your hosts on a SAN?
Correct - the option wont be available.
--Matt
I did a lot of tests and realized scp and rsync are rather slow, even rsync between to local SATA disks (about 6 MB/s IIRC). But using cp for all none vmdk files and vmkfstools -i for all vmdk files to copy them locally is acceptable for me (cp about 18 MB/s, vmkfstools about 35 MB/s). Therefore I'm pretty sure, that the limitation is on cpu or s.th. like this and not on network interface.
The next time I will make some test using iSCSI and NAS in comparison with local speed.
glim schrieb:
2. Enable unsupported sshd to your ESXi system.
3. Place this 'rsync-static-stripped' binary into /bin or somewhere else in your path on your ESXi system.
what about running rsync in daemon mode instead ? (-> http://rsync.samba.org/ftp/rsync/rsyncd.conf.html )
that should speed up things a LOT as the data doesn´t need to go trough sshd.....
I'm on annual leave till the 31st March. For urgent requests please contact Tony Ghirardi or Gavin Purnell.
--
This email and any accompanying document(s) contain information from Kent Police, which is confidential or privileged.
The information is intended to be for the exclusive use of the individual(s) or bodies to whom it is addressed.
If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of the contents of this information is prohibited.
If you have received this email in error, please notify us immediately by contacting the sender or telephoning 01622 690690.
The copyright in the contents of this email and any enclosure is the property of Kent Police and any unauthorised reproduction or disclosure is contrary to the provisions of the Copyright Designs and Patents Act 1998.
How would you run rsync in daemon mode on an ESXi box? Rsync isn't
there. . .
sure - if you don`t copy it there, it won`t be there. as any other 3rd party tool.....