New subject: Database benchmarks

17 Apr 2003

Lee Daniel Crocker wrote:

...
  Now that I have the test suite working and
installation is quick,
 I set up the software on a freshly-installed machine on my home
 network, ran the suite, reinstalled using InnoDB tables instead of
 MyISAM, ran again, installed MySQL 4.0.12, and ran again.

 The semi-bad news: there didn't seem to be any difference in
 performance with any of these changes. The variance in timing
 among setups wasn't much more than the variance from one run to
 the next. The actual numbers are below. Probably the most
 important numbers are the "sec per fetch" and "sec per search"
 at the end--those are the timings of regular page fetches and
 searches done by background threads that run during the
 conformance tests and best simulate actual use. 
The differences between MySQL versions and table types may not be the
determining factor in performance here. Inconsequential test results could
indicate a performance bottleneck on your test system. Disk throughput,
available RAM or other could be limiting all test configurations.

For Example:
-If maximum disk throughput on your test system is 18 Mbytes/sec, all
configurations may produce similar results at this level.
-Increase the disk throughput to 33 Mbytes/sec. At this level, configuration
#1 may outperform configuration #2 because it is capable of taking advantage
of the increased disk throughput. Configuration 2# may reach maximum
performance at 28 Mbytes/sec with little to no improvement at 33 Mbytes/sec.
The performance of configuration #1 could taper higher than 33 Mbytes/sec,
say 39 Mbytes/sec.

Or on the other hand, your message indicates that default MySQL
configurations were used. The default configuration options may not be
taking advantage of the resources available on your test system. The next
step could be adjusting these configurations to optimize the use of
available resources.

The fact that Wikipedia can be installed on various configurations and see
similar results, is good. Because, it provides a solid baseline for
performance measurement.

BTW, this is my first post to the list and I wanted to note and thank all of
you for the excellent work this project has produced. We are testing the
Wikipedia engine for use as a team knowledgebase. I know there are other
engines that may be more suitable for this, but it was hard to pass up the
combination of features included in Wikipedia.

Thank you.

-- Jason Dreyer

RE: [Wikitech-l] Database benchmarks