Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server

2011/12/19 Lev Serebryakov <lev@xxxxxxxxxxx>:
Hello, Samuel.
You wrote 15 декабря 2011 г., 16:32:47:

Other benchmarks in the Phoronix suite and their representations are
similarly flawed, _ALL_ of these results should be ignored and no time
should be wasted by any FreeBSD committer further evaluating this
garbage. (Yes, I have been down this rabbit hole).
 Here is one problem: we have choice from three items:

(1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD

(2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix
(communication with them, convincing, that they benchamrks are unfare
/ meaningless, ets)

(3) Lose [potential] userbase.

 You know, that these benchmarks are bad. I know. But potential (and
 even some current!) user doesn't. And it seems, that these benchmarks
 become popular over Internet.

--
// Black Lion AKA Lev Serebryakov <lev@xxxxxxxxxxx>


Here is where you completely derail the train, let me paste again what
I said before.

...
Take the first test as an example, Blogbench read. This doesn't raise
any red flags, right? At least not until you realize that Blogbench
isn't a read test, it's a read/write test. So what they have done here
is run a read/write test and then thrown away the write results for
both platforms and reported only the read results. If you dig down
into the actual results,
http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 -- you will
see two Blogbench numbers, one for read and another for write. These
were both taken from the same Blogbench run, so FreeBSD optimizes
writes over reads, that's probably a good thing for your data but a
bad thing when someone totally misrepresents benchmark results.
...

FreeBSD actually does _BETTER_ (subjectively) in this test than the
Linux system when you look at what is really going on. FreeBSD is
favoring writes, which is _GOOD_. FreeBSD does not need to be fixed,
the benchmarks need to be fixed to represent reality rather than
throwing half of the results in the trash. To be quite frank, "fixing"
FreeBSD to look good on this benchmark will make it a worse real-world
OS. But you guys go ahead and foot-shoot over these ridiculous
benchmarks all you want.

Sam
_______________________________________________
freebsd-current@xxxxxxxxxxx mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscribe@xxxxxxxxxxx"

Relevant Pages

  • Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server
    ... My personal thoughts on all of the complaints that FreeBSD isn't fast ... enough and the Phoronix benchmarks aren't representative of true ... - It's also hardware hungry, ... - Our timecounter mechanism has been noted as slow compared to Linux ...
    (freebsd-performance)
  • Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server
    ... Make FreeBSD looks good on benchmarks by "fixing" FreeBSD ... Make FreeBSD looks good on benchmarks by "fixing" Phoronix ...
    (freebsd-current)
  • Re: What version of FBSD does Yahoo run?
    ... I will repeat what I have said before - FreeBSD for my stands for a strict ... weren't you demanding an email ago that I produce benchmarks ... So I guess you recommend that anyone running a network ... Are the gains in mySQL greater that the 40% ...
    (freebsd-questions)
  • Re: Heavy I/O blocks FreeBSD box for several seconds
    ... FreeBD 9.0 and FreeBSD 8.2-STABLE tend to "freeze" ... KDE4 on Linux performs much better during high disk IO. ... those I/O-triggered blockings on boxes without any GUI. ... Today I looked at some benchmarks performed by Phoronix/openbenchmark.org ...
    (freebsd-current)
  • Re: Heavy I/O blocks FreeBSD box for several seconds
    ... FreeBD 9.0 and FreeBSD 8.2-STABLE tend to "freeze" ... KDE4 on Linux performs much better during high disk IO. ... those I/O-triggered blockings on boxes without any GUI. ... Today I looked at some benchmarks performed by Phoronix/openbenchmark.org ...
    (freebsd-questions)