Re: What would be the best way to copy lots of files from oneserver to another.

From: Tom Samplonius (tom_at_sdf.com)
Date: 06/21/03

  • Next message: Alexander Leidinger: "Re: What would be the best way to copy lots of files from one server to another." 
    Date: Sat, 21 Jun 2003 13:08:29 -0700 (PDT)
To: Simon <simon@optinet.com>

    On Sat, 21 Jun 2003, Simon wrote:

    > I recently used rsync to copy ~35gb worth of data, 1,170,168 inodes,
    > without any problem over 100mbps interface. Took 3 or so hours.
    > You do need lots of RAM, if you swap, you're screwed. RAM
    > usage would depend on number of files you need to copy at once.
    >
    > -Simon

      Yes, rsync uses large amounts of memory when the fileset is large.
    Plus, depending on your CPU, you might want to avoid using ssh encryption
    too.

      Usually if it is a LAN to LAN copy, cpdup over NFS will be WAY faster
    than rsync, and use little memory. I've used cpdup for moving mail to a
    new server. I synced before the cutover, shutdown the mail server, synced
    one more, and then brought up the mail server on the system. Very tidy.

    Tom

    _______________________________________________
    freebsd-isp@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-isp
    To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org"

  • Next message: Alexander Leidinger: "Re: What would be the best way to copy lots of files from one server to another."

    Relevant Pages

    • Re: What would be the best way to copy lots of files from oneserver to another.
      ... >> You do need lots of RAM, if you swap, you're screwed. ... I've used cpdup for moving mail to ... and then brought up the mail server on the system. ... cpio, but I have better luck with it. ...
      (freebsd-isp)
    • Re: Mail Server on 10 help
      ... > Hi ram, ... > good doucmentation in setting up the mail server (don't think that is ... > courrier, cyrus, imap,spamassasin, squirrel mail etc..., also configure ... Yes, Houghi tutorials are good. ...
      (alt.os.linux.suse)
    • Slow Network connection
      ... I'm running a couple of sites and a mail server. ... Hav ... e 512 M of RAM on a PII450 MHZ on 512/512 ADSL connection. ...
      (alt.os.linux.redhat)
    • Re: Mail server setting up, how ?
      ... Ram wrote: ... > Now I'd like to add a mail server to it. ... figure out how to get your mail from the ISP ... I don't have a setup such as that, but I have my mail servers setup at ...
      (alt.os.linux.suse)
    • Re: Firewall and DMZ topology
      ... Tha basic idea is that the firewall will ... So the LAN will be isolated ... from the DMZ ... ... > If the MAIL server is in the DMZ. ...
      (Security-Basics)