Re: consequences of migrating to maildir storage system

From: Nathan Kay (mcnate_at_numenor.net)
Date: 10/28/03

  • Next message: Charles Swiger: "Re: consequences of migrating to maildir storage system"
    Date: Mon, 27 Oct 2003 18:02:39 -0800
    To: "Eric W. Bates" <ericx@vineyard.net>
    
    

    On Thu, Oct 16, 2003 at 09:34:56AM -0400, Eric W. Bates wrote:
    > Anyone have unfortunate experiences as a consequence of converting
    > mail storage from flat file (mbox) to maildir? I'm concerned that the
    > increase in the number of files might cause problems with replication
    > (we use rsync), backup or even just running out of inodes.

            The two issues that I've seen with maildir and large mail
    environments are both file system related. First, watch your inodes, you
    may find yourself eating them up quickly. As noted already in the
    thread, newfs options can solve this issue.

            The other thing to watch out for, depending on your userbase and
    usage patterns is lost space from files smaller that your block size.

            That is to say, if your file system block size is 16k, and most
    of the email messages are 1k, that's 15k per message (on average) that
    you've lost, unless the file system is doing things to avoid it.

            Also, if you're using a network file system that pre-fetches
    file and directory attributes, you may eventually want to look into what
    your cache miss rates are for that.

            Depending on the usage patterns, pre-fetching file and directory
    attributes for network mounted file systems that are storing maildirs
    can be either a very good thing, or a very bad thing. Depends on your
    cache miss rates.

    -- 
    Nathan Kay
    Numenorean Networks
    http://www.numenor.net
    PGP Public Key: http://www.numenor.net/~mentat/pgp.asc
    "Unix is like a Vorlon: It's incredibly powerful, gives terse,
     cryptic answers, and has a lot of things going on in the
     background."
    _______________________________________________
    freebsd-isp@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-isp
    To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org"
    

  • Next message: Charles Swiger: "Re: consequences of migrating to maildir storage system"

    Relevant Pages

    • Re: Delete 4 million files
      ... I discovered a Maildir on my server with 4+ million mails in. ... files in this portion of the file system should be deleted. ... You can monitor the progress of the job by ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx with a subject of "unsubscribe". ...
      (Debian-User)
    • Re: Delete 4 million files
      ... I discovered a Maildir on my server with 4+ million mails in. ... files in this portion of the file system should be deleted. ... You can monitor the progress of the job by ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx ...
      (Debian-User)
    • Very slow header cache in mutt if the maildir is on ext3
      ... I tested with the maildir on XFS. ... Then I discovered that the mutt header cache ... different hard disk on an XFS file system. ...
      (Linux-Kernel)
    • Re: [SLE] KMail question
      ... > via an explicit use of a file locking system call or protocol or whether ... >> One of the benefits of the maildir format is that, ... so there's no chance of lock conflicts on the mail storage used ... >> spools. ...
      (SuSE)
    • Re: Mail Quota on Sendmail
      ... The 2.1 GB sounds like a file system limit on the size of a single file. ... If this is the case you will have to have a file system and binaries that support individual files being larger than 2 GB. ... I'm betting that you would have better performance too as dealing with a multi-gigabyte mail spool file will be a *big* PITA for the system, where as Maildir will be *MUCH* nicer on the system. ...
      (comp.mail.sendmail)