Re: NFS small files

From: Peter Hessler (phessler_at_coverity.com)
Date: 03/09/05

  • Next message: Eric Anderson: "Re: NFS small files" 
    Date: Tue, 8 Mar 2005 17:51:19 -0800
To: freebsd-performance@freebsd.org

    I should mention that copying the same directory on the nfs server takes
    15s, rather than the 54s over nfs.

    On Tue, 8 Mar 2005 17:46:31 -0800
    Peter Hessler <phessler@coverity.com> wrote:

    : These files are sitting right next to each other on disk, I created
    them
    : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i
    : bs=128 count=128; done""". Then I timed the copy of that directory.
    :
    : Does seek really cause an 11x performance penalty?
    :
    : On Tue, 08 Mar 2005 17:40:44 -0800
    : Peter Kieser <pfak@telus.net> wrote:
    :
    : : Copying single files are always going to take longer, because the
    : drive
    : : has to seek more thus latency is introduced.
    : :
    : : --Peter
    : :
    : : Peter Hessler wrote:
    : :
    : : >I'm setting up an NFS server to be used for compiling, and it seems
    : that
    : : >while speeds are acceptable for large files, small files take much
    : : >longer than expected.
    : : >
    : : >Copying 10000 16K files (in a directory) takes 54seconds, while
    : copying
    : : >a 170M single file takes 5s.
    : : >
    : : >Are there any tricks for speeding up small file performance? I'm
    : : >willing to give up large file performance.
    : : >
    : : >/etc/sysctl.conf:
    : : > vfs.vmiodirenable=1
    : : > kern.ipc.somaxconn=2048
    : : > kern.maxfiles=65536
    : : > net.isr.enable=1
    : : >
    : : >/boot/loader.conf:
    : : > kern.ipc.nmbclusters=32768
    : : >
    : : >Kernel Conf:
    : : > include GENERIC
    : : > ident NFS
    : : > options DEVICE_POLLING
    : : > options HZ=1000
    : : >_______________________________________________
    : : >freebsd-performance@freebsd.org mailing list
    : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance
    : : >To unsubscribe, send any mail to
    : "freebsd-performance-unsubscribe@freebsd.org"
    : : >
    : : >
    : : >
    : :
    : : _______________________________________________
    : : freebsd-performance@freebsd.org mailing list
    : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
    : : To unsubscribe, send any mail to
    : "freebsd-performance-unsubscribe@freebsd.org"
    : _______________________________________________
    : freebsd-performance@freebsd.org mailing list
    : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
    : To unsubscribe, send any mail to
    "freebsd-performance-unsubscribe@freebsd.org"
    _______________________________________________
    freebsd-performance@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-performance
    To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"

  • Next message: Eric Anderson: "Re: NFS small files"

    Relevant Pages

    • Re: NFS small files
      ... :> I should mention that copying the same directory on the nfs server takes ... rather than the 54s over nfs. ... :> Peter Hessler wrote: ... :>: To unsubscribe, send any mail to ...
      (freebsd-performance)
    • Re: copying a 12GB file
      ... i wrote and read 40 gb daha to nfs server without ... kernel 2.4.20. ... When trying to copy the file in async mode, I got between 1.5--2 GB only before ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx with a subject of "unsubscribe". ...
      (Debian-User)
    • Netdev Watchdog timeout and badness in local_bh_enable
      ... I have a machine which, amongst other things, acts as an NFS server ... (copying a large file, opening a large maildir in mutt), it generates ... Kernel is 2.6.2-rc2. ... send the line "unsubscribe linux-kernel" in ...
      (Linux-Kernel)
    • Re: FUSE and NFS
      ... is there a way to use FUSE to mount a partition ... served by a NFS server? ... implementation in the kernel? ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx with a subject of "unsubscribe". ...
      (Debian-User)
    • nfs problem
      ... nfs server 192.168.110.28 ... It's really strange.. ... Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx ...
      (Debian-User)