Re: ** I/O performance for backup - tar , rsync , cp on FreeBSD **

On Wed, 9 Jul 2008 18:44:39 UTC, David <david4731@xxxxxxxxxxx> wrote:

So what is the most efficient way to copy so many files from one drive
to another ? is there a way to tar it without needing twice the
space on the destination for an untar afterwards?

The way I learned years ago was to use back-to-back tar... feeding
standard output of one into standard input of the other. However,
there's still the small file handling.

You might try pax or cpio and see if they work better; also make sure
the file systems are tuned correctly. Setting noatime on the source
mount might help, too.
--
Bob Eager
UNIX since v6..
http://tinyurl.com/2xqr6h

.

Relevant Pages

  • Re: ** I/O performance for backup - tar , rsync , cp on FreeBSD **
    ... The way I learned years ago was to use back-to-back tar... ... standard output of one into standard input of the other. ... there's still the small file handling. ... You might try pax or cpio and see if they work better; ...
    (comp.unix.bsd.freebsd.misc)
  • Re: ksh help: redirect standard error
    ... I try to capture all the errors from tar command, NOT standard output. ...
    (comp.unix.shell)
  • Re: tar help
    ... I only know tar, ... > standard output and they use standard input, ... What about the restriction with various versions of cpio and the maximum ... DeeDee, don't press that button! ...
    (comp.unix.admin)
  • Re: creating multi volume tar files .tar1, .tar2 etc
    ... tar would do something intelligently. ... > Can someone tell me a way that i can tar up (tar, zip, compress i dont ... Hi Ian, ... The -O option to tar says to send the archive to the standard output. ...
    (RedHat)
  • Re: Network pipes
    ... > local and the remote host with the standard output of tar and the standard ... > input of dd redirected to that socket. ... Authentication is still performed ...
    (freebsd-hackers)