Thanks guys thats good stuff to keep in mind.
On Mon, 2008-30-06 at 16:09 -0600, Brendan Zerr wrote:
> For large amounts of data, I've always used the 'Fast Tar Copy' as
> it's described on http://gentoo-wiki.com/TIP_Fast_Copy
> Local to Remote:
> tar czv ListOfFiles | ssh remote.box.com tar xz -C /home/user/PathToCopy
> Local to Remote, faster encryption:
> tar czv ListOfFiles | ssh -c blowfish remote.box.com tar xz -C /home/user/PathToCopy
> Brendan Zerr
>
>
> Dave Hall wrote:
> > On Mon, Jun 30, 2008 at 03:27:02PM -0600, rob wrote:
> >
> > > >From the stuff I had done moving 40->60gb pcap files scp seemed to fault
> > > and leave me hanging whereas rsynch via ssh didn't fail and if it does
> > > it picks up where it left off next time. Just wondering if there is some
> > > interaction with the IP stack thats different
> > >
> >
> > Ah, yeah, that's a lot of data. I think I have an idea what's likely
> > happening.
> >
> > The disc on the target probably can't write data as fast as data can
> > come over the network. rsync is probably more intellegent about
> > buffering compared to scp which is basically cp over SSH. If you watch
> > the kernel's buffer size, it will probably max out just before the
> > transfer dies.
> >
> >
Received on Mon Jun 30 17:14:50 2008
This archive was generated by hypermail 2.1.8 : Mon Jun 30 2008 - 17:14:53 CST