Talk:TIP Fast Copy

From Gentoo Linux Wiki

Jump to: navigation, search

Contents

[edit] Fast network transfer?

neat :)

I've heard you can also use this along with netcat to transfer files across a network, and you can then use bzip/gzip for compression. I have not tried it, however I don't think it would be overly difficult :) -- Kitchen

But rsync with --compress option can be used for that. I'm not sure, whether this is as fast as tar when used for copying files locally. -- Sridharinfinity 01:44, 27 Jul 2004 (GMT)
I think rsync can do secure and fast transfers, with the -e option (rsync -e /bin/ssh)--Nomorsad 22:03, 26 Nov 2004 (GMT)


Over ssh all you have to do is 'ssh -C <files> desthost:destdir/' and it compresses and uncompresses for you on the fly. No need to do it manually. -- jkcunningham 20:07, 15 Aug 2004 (PDT)

How would lzop work over ssh?


  • If there were a way to bind these to aliases they would be more useful. --Gherald
  • alias fast_scp="scp -C"

[edit] *Fast* copying with tar...(doesn't work for me)

For me, copying a directory (207, different sizes of files from tiny to 20mb) took about 47s with cp and 50s with the suggested tar method. Or is this supposed to work only for especially large or small files?

I imagine it might help for small files. Given the existance of write buffers I'm not sure how though.

The 'tar' way is a lot slower than 'cp' when doing a local copy from on disk to another. did a test 2 dirs. total 1.1GB 

BOB@gentoo srv $ time tar -cf - misc/ downloads/ | tar -C /TEMP/ -xf -

real    2m15.328s
user    0m0.388s
sys     0m18.402s
BOB@gentoo srv $ rm -Rf /TEMP/*
BOB@gentoo srv $ time cp -R misc/ downloads/ /TEMP/

real    1m24.725s
user    0m0.126s
sys     0m13.884s

The time taken talks for itself =8(

[edit] Rsync

Some people prefer rsync and its options even for copying, but specially over a network.

[edit] Buffer

Found something interesting here: http://lists.debian.org/debian-user/2001/06/msg00288.html

[edit] Bash filecopy over network

can someone try to make to copy a file with only(!) bash network abilities ? see 'man bash' redirection section (/dev/tcp/host/port or /dev/udp/host/port)

Retrieved from "http://www.gentoo-wiki.com/Talk:TIP_Fast_Copy"
Personal tools