Re: Progress on scaling of FreeBSD on 8 CPU systems

On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote:
Now that the goals of the SMPng project are complete, for the past
year or more several of us have been working hard on profiling FreeBSD
in various multiprocessor workloads, and looking for performance
bottlenecks to be optimized.

We have recently made significant progress on optimizing for MySQL
running on an 8-core amd64 system. The graph of results may be found
here:

http://www.freebsd.org/~kris/scaling/scaling.png

This shows the graph of MySQL transactions/second performed by a
multi-threaded client workload against a local MySQL database with
varying numbers of client threads, with identically configured FreeBSD
and Linux systems on the same machine.

The test was run on FreeBSD 7.0, with the latest version of the ULE
2.0 scheduler, the libthr threading library, and an uncommitted patch
from Jeff Roberson [1] that addresses poor scalability of file
descriptor locking (using a new sleepable mutex primitive); this patch
is responsible for almost all of the performance and scaling
improvements measured. It also includes some other patches (collected
in my kris-contention p4 branch) that have been shown to help
contention in MySQL workloads in the past (including a UNIX domain
socket locking pushdown patch from Robert Watson), but these were
shown to only give small individual contributions, with a cumulative
effect on the order of 5-10%.

I wonder if anyone measured what effect superpages has on mysql performance...
this should not help scaling but I can imagine it has some effect.
_______________________________________________
freebsd-current@xxxxxxxxxxx mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscribe@xxxxxxxxxxx"

Relevant Pages

  • Re: Progress on scaling of FreeBSD on 8 CPU systems
    ... year or more several of us have been working hard on profiling FreeBSD ... We have recently made significant progress on optimizing for MySQL ... contention in MySQL workloads in the past (including a UNIX domain ...
    (freebsd-hackers)
  • Re: Progress on scaling of FreeBSD on 8 CPU systems
    ... year or more several of us have been working hard on profiling FreeBSD ... We have recently made significant progress on optimizing for MySQL ... contention in MySQL workloads in the past (including a UNIX domain ...
    (freebsd-performance)
  • Re: Fine grain select locking.
    ... This patch also uses a vm zone for the selfd structures. ... We do best at optimizing where we have clearly defined targets and measures of performance. ... The four-times increase in MySQL select performance is a direct result of Kris taking on scalability measurement and helping developers with optimization ideas try them out, profile them, etc. ... A point I've made at a number of devsummits and elsewhere is that what we really need now is more people to "take ownership" of the performance of workloads they care about. ...
    (freebsd-arch)
  • Re: Progress on scaling of FreeBSD on 8 CPU systems
    ... year or more several of us have been working hard on profiling FreeBSD ... We have recently made significant progress on optimizing for MySQL ... contention in MySQL workloads in the past (including a UNIX domain ...
    (freebsd-performance)
  • Re: Feedback for performance tracker
    ... The four-times increase in MySQL select ... Here are some workloads I'd really like to see people take responsibility for: ... Flat file Apache performance, perhaps with Apachebench or another HTTP ... but optimizing build performance still has a big benefit for developers. ...
    (freebsd-current)