Re: FreeBSD 5.3 I/O Performance / Linux 2.6.10 | Continued Discussion

From: Robert Watson (rwatson_at_FreeBSD.org)
Date: 01/28/05

  • Next message: Mike Tancsa: "Re: FreeBSD 5.3 I/O Performance / Linux 2.6.10 | Continued Discussion"
    Date: Fri, 28 Jan 2005 01:14:54 +0000 (GMT)
    To: Nick Pavlica <linicks@gmail.com>
    
    

    On Thu, 27 Jan 2005, Nick Pavlica wrote:

    > > The move to an MPSAFE VFS will help with that a lot, I should think.
    >
    > Do you know if this will find it's way to 5.x in the near future?

    Hopefully not too quickly, it's fairly experimental. I know there's
    interest in getting it into 5.x however. Perhaps once it's settled for a
    few months and we've confirmed that in the "off" state it's quite
    un-harmful, it can be merged.

    > > Also, while on face value this may seem odd, could you try the following
    > > additional variables:
    > >
    > > - Layer the test UFS partition directly over ad0 instead of ad0s1a
    > > - UFS1 vs UFS2
    >
    > I just tested with UFS1 and had almost the exact same results.

    OK, thanks.

    > > Finally, in as much as is possible, make sure that the layout of the disks
    > > is approximately the same -- as countless benchmarking papers show, there
    > > are substantial differences (10%+) in I/O throughput depending on where on
    > > the disk surface operations occur. That's one of the reasons to try UFS1
    > > for the test partition, although not the only one.
    >
    > My tests use the exact same disk layout, and hardware. However, I have
    > had consistent results on all 4 boxes that I have tested on.
    >
    > At this point I'm making the assumption that the poor disk I/O
    > performance on 5.3 isn't a file system issue, but is tied to a larger
    > issue with the Kernel (I know never make assumptions ... :)). In all my
    > testing, I have noticed that 5.3 doesn't appear to release cpu resources
    > even if there isn't any other demand for resources. I would compare it
    > to driveling a car with a governor on it. When I tested with 4.11, it
    > allocated considerably more resources. I do hope that the 5.x issues
    > are resolved soon so that I can deploy may production servers on it
    > rather than starting on 4 and them making the big switch. I will
    > probably test 6 for the fun of it.

    Forgive me if this was in previous e-mails and I missed it, but -- how
    does I/O directly on /dev/[diskdevice] differ as compared to the file
    system I/O? In particular, it's interesting to compare both large block
    I/O (reads, writes at fairly large multiples of the sector size -- 512k is
    a good number) and small I/O size (512 bytes is good). This will help
    identify the source along two dimmensions: are we looking at a basic
    storage I/O problem that's present even without the file system, or can we
    conclude that some of the additional extra cost is in the file system code
    or the hand off to it. Also, with the large and small I/O size, we can
    perhaps draw some conclusions about to what extent the source is a
    per-transaction overhead.

    Finally -- I figure you've done this already, but it's worth asking -- can
    you confirm that your hardware is negotiating the same basic parameters
    under 5.x and 4.x? In particular, the ATA code has changed substantially,
    so if using ATA hardware you want to confirm that the same DMA mode is
    negotiated.

    Robert N M Watson

    _______________________________________________
    freebsd-performance@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-performance
    To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"


  • Next message: Mike Tancsa: "Re: FreeBSD 5.3 I/O Performance / Linux 2.6.10 | Continued Discussion"

    Relevant Pages

    • Re: Treads in the new 6 core CPU from Intel
      ... Why do you think six cores are "fighting" for resources? ... implications of an asymmetric I/O bus structure on file system I/O? ... Why do you think the file I/O is not taking advantage of the File System Cache? ... What, in fact, do you mean by the phrase "database ...
      (microsoft.public.vc.mfc)
    • Re: Closed file system was Re: END-IF
      ... there was NO file system. ... Vendors of hardware provided some I/O methods to match their ... > resources, not use. ... > My point is that COBOL had nothing to do with this change. ...
      (comp.lang.cobol)
    • Re: Read/Write to storage class device using sector/block addresses
      ... Well, any time you are writing directly to the disk, I would hope that there ... open just one partition raw and have a file system driver on another. ... class driver and should only be used for infrequent I/O processing. ...
      (microsoft.public.win32.programmer.kernel)
    • Re: Redo logs a Quick I/O enabled file system
      ... I/O enabled file system? ... I found no reason to place redo logs on such a file system. ... I know that for a UFS file system Direct I/O should be specified ...
      (comp.databases.oracle.server)
    • Re: Why doesnt (open ... :if-exists) support :truncate?
      ... | at some point doing I/O directly to the existing file. ... Try to minimize cache effects of the I/O to and from this file. ... Under Linux 2.4 transfer sizes, ... block size of the file system. ...
      (comp.lang.lisp)