Re: SCP VS rsync+ssh

Nice Info on that weblink.

Cal G
  ----- Original Message -----
  From: Brendan Zerr
  To: linux@slg.org
  Sent: Monday, June 30, 2008 4:09 PM
  Subject: Re: SCP VS rsync+ssh

  For large amounts of data, I've always used the 'Fast Tar Copy' as it's described on http://gentoo-wiki.com/TIP_Fast_Copy

Local to Remote:
        tar czv ListOfFiles | ssh remote.box.com tar xz -C /home/user/PathToCopy
Local to Remote, faster encryption:
        tar czv ListOfFiles | ssh -c blowfish remote.box.com tar xz -C /home/user/PathToCopy
Brendan Zerr

  Dave Hall wrote:
On Mon, Jun 30, 2008 at 03:27:02PM -0600, rob wrote:
>From the stuff I had done moving 40->60gb pcap files scp seemed to fault
and leave me hanging whereas rsynch via ssh didn't fail and if it does
it picks up where it left off next time. Just wondering if there is some
interaction with the IP stack thats different
    
Ah, yeah, that's a lot of data. I think I have an idea what's likely
happening.

The disc on the target probably can't write data as fast as data can
come over the network. rsync is probably more intellegent about
buffering compared to scp which is basically cp over SSH. If you watch
the kernel's buffer size, it will probably max out just before the
transfer dies.
Received on Tue Jul 1 05:40:36 2008