[Nottingham] Parallel rsync?

Jason Irwin jasonirwin73 at gmail.com
Mon Jul 29 13:27:03 UTC 2013


On 29/07/13 13:01, Dan Caseley wrote:
> I've no idea how to achieve this, but i thought I'd ask for my own
> curiosity - what's the advantage to running parallel rather than series?
> Isn't the pipe going to be the limiting factor here in any scenario?
We're having something of a "file transfer war" in the office at the
moment and one of .
A normal Windows copy takes ~10 hours
robocopy 15 mins
rysnc ~8 mins!

robocopy can execute in a multi-threaded manner to alleviate the
bottle-neck over what files to copy (this can take some time, especially
with lots of files, even for rsync).  As we may start to copy very large
folder structures, that is a concern.

I want rsync to win, dammit, as robocopy will suck over the VPN (no
compression, file delta etc).

-- 
╔═════════════╦══════════════════════════════════════════╗
║ Jason Irwin ║ OpenPGP (GPG/PGP) Public Key: 0xD0C592B1 ║
║             ║ Import from hkp://subkeys.pgp.net        ║
╚═════════════╩══════════════════════════════════════════╝



More information about the Nottingham mailing list