Re: 20TB Storage System (fsck????)

From: Chuck Swiger (cswiger_at_mac.com)
Date: 09/03/03

  • Next message: Piotr KUCHARSKI: "Re: 20TB Storage System (fsck????)" 
    Date: Wed, 03 Sep 2003 14:37:50 -0400

    Max Clark wrote:
    > Ohh, that's an interesting snag. I was under the impression that 5.x w/ PAE
    > could address more than 4GB of Ram.

    It can. PAE lets the hardware address more than 4GB of RAM, but that doesn't
    change how much memory you can give to any one process: a 32-bit process still
    has a 32-bit virtual address space.

    > If fsck requires 700K for each 1GB of Disk, we are talking about 7GB of Ram
    > for 10TB of disk. Is this correct? Will PAE not function correctly to give
    > me 8GB of Ram? To check 10TB of disk?

    Another thread suggests that the maximum amount of memory actually available for
    a 32-bit process to use under FreeBSD is a little less than 3 GB.

    > Is there anyway to bypass this requirement and split fsck into smaller
    > chunks? Being able to fsck my disk is kinda important.

    Sure. Create multiple filesystems rather than just one, and use symlinks to
    make the directory namespace fit your needs.

    I don't know enough about your tasks to give you really specific advice, but I'm
    wary of the write-performance hit from putting too many drives wide in a RAID-5
    (or -5,0) configuration. If you can split up your data by role or typical
    access pattern, you might well be able to identify some chunks that will be
    read-mostly (and RAID-5,0 is a good fit) and others that will be read-write or
    even write-mostly (and thus should be on -1,0). You can also tune other things
    like blocksize, # of inodes, and so forth more appropriately for each filesystem. 

    -- 
-Chuck
_______________________________________________
freebsd-performance@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"
  • Next message: Piotr KUCHARSKI: "Re: 20TB Storage System (fsck????)"

    Relevant Pages

    • Re: performance: store.exe uses 579Mb only out of 4Gb
      ... RAM is mainly used by store.exe in the form of database page buffers. ... You'll find more information on optimizing memory for Exchange in: ... The fact that you're using optin implies that you have a server based on ... response from the vendor is to do something to enable PAE, ...
      (microsoft.public.exchange.admin)
    • Re: 20TB Storage System (fsck????)
      ... I was under the impression that 5.x w/ PAE ... PAE lets the hardware address more than 4GB of RAM, ... make the directory namespace fit your needs. ... wary of the write-performance hit from putting too many drives wide in a RAID-5 ...
      (freebsd-hackers)
    • RE: [Backtrace] 4.9 and 5.1-RELEASE occasionly panic on RAM > 4GB without PAE (long)
      ... > work fine with!PAE. ... vmstat -m is useful to keep track of kernel memory use. ... When we have removed some RAM, in other words, install 2GB memory on the ... I think this is important, however, I got no reason why a server ...
      (freebsd-current)
    • RE: [Backtrace] 4.9 and 5.1-RELEASE occasionly panic on RAM > 4GB without PAE (long)
      ... > work fine with!PAE. ... vmstat -m is useful to keep track of kernel memory use. ... When we have removed some RAM, in other words, install 2GB memory on the ... I think this is important, however, I got no reason why a server ...
      (freebsd-stable)
    • Re: 4GB RAM with an intel core 2 processor
      ... When I install the 2 extra memory modules, the kernel tells me on startup ... I took a quick look at PAE and discovered that the PAE kernel is ... Do I have any options for using my 4GB of RAM and still retain USB and the nvidia driver? ...
      (freebsd-current)