Re: Bad performance when accessing a lot of small files
- From: "Alexandre Biancalana" <biancalana@xxxxxxxxx>
- Date: Sat, 29 Dec 2007 13:50:29 -0200
On Dec 28, 2007 7:38 PM, Alfred Perlstein <alfred@xxxxxxxxxxx> wrote:
* Alexandre Biancalana <biancalana@xxxxxxxxx> [071225 16:45] wrote:
On 12/21/07, Alfred Perlstein <alfred@xxxxxxxxxxx> wrote:
Have you tried the 'noatime' mount option? That should help.
Yeah, the zfs set atime=off was already done....
Can you provide a histogram of the count of files per directory?
Excuse-me, but I don't understand....
Distribution of files per directory, example:
1000 files in 9 dirs
1001 files in 12 dirs
find /path_to_root/ -type f | sed 's/\/[^/]*$//' | uniq -c | \
awk '{print $1}' | sort -n | uniq -c
That will print out the number of files per dir.
2 98
3 102
1 103
2 105
Ohh yes !! Now I understand....
The problem is that last night the server stop responding and now is
panicing with the message:
ZFS(panic): zfs: allocating allocated segment(offset=2781261201408 size=131072)
_______________________________________________
freebsd-performance@xxxxxxxxxxx mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "freebsd-performance-unsubscribe@xxxxxxxxxxx"
- References:
- Bad performance when accessing a lot of small files
- From: Alexandre Biancalana
- Re: Bad performance when accessing a lot of small files
- From: Alfred Perlstein
- Re: Bad performance when accessing a lot of small files
- From: Alexandre Biancalana
- Re: Bad performance when accessing a lot of small files
- From: Alfred Perlstein
- Re: Bad performance when accessing a lot of small files
- From: Alexandre Biancalana
- Re: Bad performance when accessing a lot of small files
- From: Alfred Perlstein
- Re: Bad performance when accessing a lot of small files
- From: Alexandre Biancalana
- Re: Bad performance when accessing a lot of small files
- From: Alfred Perlstein
- Bad performance when accessing a lot of small files
- Prev by Date: Re: Bad performance when accessing a lot of small files
- Next by Date: Re: mysql scaling questions
- Previous by thread: Re: Bad performance when accessing a lot of small files
- Next by thread: intel drivers vs. freebsd drivers
- Index(es):