Re: No of files in a directory (performance)
From: Fredrik (paltskallen_at_hotmail.com)
Date: 03/04/04
- Previous message: Zoong Pham: "Re: Speeding up NetRain response times for 5.1."
- In reply to: Bob Harris: "Re: No of files in a directory (performance)"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: 3 Mar 2004 23:57:26 -0800
I did
rm -rf first_directory_to_remove
so I think -rf are doing som wierd stuff...
Bob Harris <harris@zk3.dec.com> wrote in message news:<harris-8A1069.10595103032004@juggl7.zk3.dec.com>...
> In article <ff81d3b0.0403030726.38e36a24@posting.google.com>,
> paltskallen@hotmail.com (Fredrik) wrote:
>
> > OK.
> >
> > I have noticed that rm -rf on a dir takes way longer on a dir with
> > many files in it, ex if there are 10k files it takes 10 sec, but with
> > 70k files it takes 150 sec.
> >
> > find|xargs rm
> > takes the same time (per file that is). It seems that -rf does some
> > magic that slows it down.
> >
> >
> > Bob Harris <harris@zk3.dec.com> wrote in message
> > news:<harris-8A4C82.20384627022004@cacnews.cac.cpqcorp.net>...
> > > In article <ff81d3b0.0402270129.205a3e@posting.google.com>,
> > > paltskallen@hotmail.com (Fredrik) wrote:
> > >
> > > > Hello!
> > > >
> > > > We have an application that creates and reads a lot of files.
> > > > These files are splitted on 100 dirs. Currently there are ~70 000 files
> > > > in
> > > > each dir.
> > > > Are there any limit that should be considered regarding to performance
> > > > issues??
> > > >
> > > > Using advfs and san disks.
> > >
> > > AdvFS in Tru64 UNIX v5.0 or later uses b-tree indexing for directory
> > > access. While a huge directory does take slightly longer to create,
> > > lookup, delete a file, it is _NOT_ linear. The performance is really
> > > very good.
> > >
> > > However, if you ask 'ls' to display all the files it will take a long
> > > time to fetch all the files, then sort them, and then display them, but
> > > if you use 'ls -f' it skips the sorting, which can make things faster.
> > >
> > > Bob Harris
>
> Did you do
>
> rm -rf *
>
> or
>
> rm -rf first_directory_to_remove
>
> If the first, then the shell you are using will first collect all the
> file names, then sort them, then substitute them on the command line,
> then it will invoke rm.
>
> The find command doesn't sort anything.
>
> If you did the 2nd example, then it must be something in rm, as the file
> system doesn't really know know what command is being used to delete
> something.
>
> Bob Harris
- Previous message: Zoong Pham: "Re: Speeding up NetRain response times for 5.1."
- In reply to: Bob Harris: "Re: No of files in a directory (performance)"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Relevant Pages
|
