Re: SCP VS rsync+ssh

For large amounts of data, I've always used the 'Fast Tar Copy' as it's
described on http://gentoo-wiki.com/TIP_Fast_Copy

Local to Remote:
        tar czv ListOfFiles | ssh remote.box.com tar xz -C /home/user/PathToCopy
Local to Remote, faster encryption:
        tar czv ListOfFiles | ssh -c blowfish remote.box.com tar xz -C /home/user/PathToCopy

*Brendan Zerr*

Dave Hall wrote:
> On Mon, Jun 30, 2008 at 03:27:02PM -0600, rob wrote:
>
>> >From the stuff I had done moving 40->60gb pcap files scp seemed to fault
>> and leave me hanging whereas rsynch via ssh didn't fail and if it does
>> it picks up where it left off next time. Just wondering if there is some
>> interaction with the IP stack thats different
>>
>
> Ah, yeah, that's a lot of data. I think I have an idea what's likely
> happening.
>
> The disc on the target probably can't write data as fast as data can
> come over the network. rsync is probably more intellegent about
> buffering compared to scp which is basically cp over SSH. If you watch
> the kernel's buffer size, it will probably max out just before the
> transfer dies.
>
>
Received on Mon Jun 30 16:09:56 2008