Path: utzoo!utgpu!news-server.csri.toronto.edu!cs.utexas.edu!wuarchive!usc!apple!veritas!amdcad!mozart.amd.com!proton!tim
From: tim@proton.amd.com (Tim Olson)
Newsgroups: comp.benchmarks
Subject: Re: Don't use bc (was: More issues of benchmarking)
Message-ID: <1990Dec6.221422.5676@mozart.amd.com>
Date: 6 Dec 90 22:14:22 GMT
References: <1990Dec3.204027.16794@cs.utk.edu> <109872@convex.convex.com> <1990Dec6.000702.16354@watmath.waterloo.edu>
Sender: usenet@mozart.amd.com (Usenet News)
Reply-To: tim@amd.com (Tim Olson)
Organization: Advanced Micro Devices, Austin, TX
Lines: 42

In article <1990Dec6.000702.16354@watmath.waterloo.edu> mhcoffin@watmsg.uwaterloo.ca (Michael Coffin) writes:
| It is only worse than worthless if it doesn't correlate well with real
| performance.  Does anyone have SPECmark numbers for these machines?
| It would be interesting to run correlations between SPECmark and
| BCmark.  I'll be the correlation is high.

Well, it is fairly high, but that may be due to the limited
intersection of machines which have SPECMarks and machines listed on
the bc benchmark.  Here's what I have found so far:

SYSTEM                   TIME   SPEC   comp	ratio
------                   ----   
MIPS RC6280              2.8    44.0   44.0	1.00
IBM RS/6000 Model 530	 3.4    28.9   36.2	1.25
IBM RS/6000 Model 730    3.5    29.0   35.1	1.21
IBM RS/6000 320          4.4    22.3   27.9	1.25
Motorola 8612 33MHz 88k  5.2    17.8   23.6	1.33
SGI 4D25                 8.1    12.2   15.2	1.25
SPARCstation 1+         12.2    11.8   10.1	0.86
VAX 6410 (4.0)          12.8     6.8    9.6	1.41
SPARCstation 1          16.0     8.4	7.7	0.92

The "comp" column is a computed SPECMark based upon the bc time (1/t *
123) -- the 123 was chosen as the scale factor (assuming a linear
relationship of 1/t with SPECMark) so that the first machine (MIPS
RC6280) matched.

Note that the only CISC machine in the listing, a VAX 6410, has a high
ratio of real SPECMark to "computed" SPECMark, compared to the other
machines.  Also, the SPARCstations are predicted ~10% low, while the
MIPS-based machines are predicted 25% high.


*** PLEASE *** don't try to turn this into a quick way to guess a
SPECMark; numbers are for informational purposes, only! ;-)



--
	-- Tim Olson
	Advanced Micro Devices
	(tim@amd.com)


Brought to you by Super Global Mega Corp .com