[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article
Free access

Performance variation across benchmark suites

Published: 01 July 1991 Publication History

Abstract

The performance ratio between two systems tends to vary across different benchmarks. Here we study this variation as a "signature" or "fingerprint" of the systems under consideration. This "fingerprint" can be used to guess the performance of programs not represented in a benchmark suite, assess the breadth and credibility of the benchmark suite, and infer details of the system design.

References

[1]
{1} P.J. Fleming, J.J. Wallace. How not to Lie with Statistics: the Correct Way to Summarize Benchmark Results. CACM 29, 3 (March 1986), 218-221.
[2]
{2} R.P. Gabriel. Performance Evaluation of Lisp Systems. MIT Press, Cambridge, MA (1985).
[3]
{3} R.R. Kessler. Private Communication, 6/12/88.
[4]
{4} G. Krasner. Smalltalk-80: Bits of History, Words of Advice. Addison-Wesley Publishing Co., Reading, MA (1984).
[5]
{5} H.M. Levy, D.W. Clark. On the Use of Benchmarks for Measuring System Performance. Computer Architecture News 10, 6 (Dec. 1982), 5-8.
[6]
{6} J.B. Marti, A.C. Hearn. Reduce as a LISP Benchmark. ACM SIGSAM Bulletin 19, 3 (Aug. 1985), 8-16.
[7]
{7} Performance Brief Part 1: CPU Benchmarks (Issue 3.0). MIPS Computer Systems Inc., Sunnyvale CA (Oct. 1987).
[8]
{8} Smalltalk-80 Newsletter 7. ParcPlace Systems, Palo Alto CA (Oct. 1985), page 5.

Cited By

View all
  • (1995)Pollution control cachingProceedings of ICCD '95 International Conference on Computer Design. VLSI in Computers and Processors10.1109/ICCD.1995.528825(300-306)Online publication date: 1995

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGARCH Computer Architecture News
ACM SIGARCH Computer Architecture News  Volume 19, Issue 4
June 1991
184 pages
ISSN:0163-5964
DOI:10.1145/122576
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 1991
Published in SIGARCH Volume 19, Issue 4

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)40
  • Downloads (Last 6 weeks)18
Reflects downloads up to 11 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (1995)Pollution control cachingProceedings of ICCD '95 International Conference on Computer Design. VLSI in Computers and Processors10.1109/ICCD.1995.528825(300-306)Online publication date: 1995

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media