Re: Large number of files in a directory

From: JOSEPH KREMBLAS (JKREMBLAS_at_REDHEARTGIFTS.COM)
Date: 03/27/04

  • Next message: pSeries AIX Geek: "Async I/O at AIX 5.2"
    Date:         Sat, 27 Mar 2004 15:43:00 -0700
    To: aix-l@Princeton.EDU
    
    

    Couple of questions:

            (1) Is this a local filesystem or an NFS-mounted directory?

            (2) What type of I/O requests are typically performed on the
    files? Write? Read-Only? Read-Write?
            (3) What are you managing so many files in the first place?
            (4) Are you running AIX? LVM?
            (5) Are the files random files or user-generated files?
            (6) What's the business purpose of the files?

     -----Original Message-----
    From: IBM AIX Discussion List [mailto:aix-l@Princeton.EDU] On Behalf Of
    Wesley Joyce
    Sent: Saturday, March 27, 2004 1:45 PM
    To: aix-l@Princeton.EDU
    Subject: Re: Large number of files in a directory

    Create a JFS2 based file system.

    also try defragfs

    At 03:00 PM 3/27/2004, you wrote:

    Hello,<?xml:namespace prefix = o ns =
    "urn:schemas-microsoft-com:office:office" />

     We are experiencing a performance degradation when we have to manage a
    directory with a large number of files (say, 20,000). I suppose this
    happens because the file system has to make a linear lookup into the
    directory to find a file name.

     Is there anything to tune to improve performance?

     Thanks

    ---
    Incoming mail is certified Virus Free.
    Checked by AVG anti-virus system (http://www.grisoft.com).
    Version: 6.0.644 / Virus Database: 412 - Release Date: 3/26/2004
    

  • Next message: pSeries AIX Geek: "Async I/O at AIX 5.2"

    Relevant Pages

    • Re: Large number of files in a directory
      ... Create a JFS2 based file system. ... >Incoming mail is certified Virus Free. ... Outgoing mail is certified Virus Free. ...
      (AIX-L)
    • Re: any ideas to fix filesystem /var ? - "defrags?"
      ... The command "defragfs" is used to Increases a file system's contiguous free ... You can specify the file system to be defragmented with the Device variable, ... The defragfs command is intended for fragmented and compressed file systems. ...
      (AIX-L)
    • Re: JFS2 - good or bad?
      ... IBM says error logging for JFS2 won't be in place until 5.3 comes out. ... Darn dbas claim ... every file system they use needs large file system support (clearly not ... >each type of filesystem? ...
      (AIX-L)
    • Re: chfs -a splicopy on AIX 5.2 with jfs2?
      ... I'll check on the splitvg command. ... systems and it worked fine from AIX 4.3.2 up to AIX 5.1. ... Using the same command on a JFS2, we just immediately get the shell ... we would like to make use of the new JFS2 file system because ...
      (comp.unix.aix)
    • Re: splitcopy
      ... the splitcopy command does not work on a JFS2 file system. ... We were told we should be using the snapshot command when trying to ...
      (comp.unix.aix)