More Web Proxy on the site http://driver.im/

Article

Free access

Supercomputer performance evaluation and the Perfect Benchmarks

Authors:

George Cybenko,

David KuckAuthors Info & Claims

ICS '90: Proceedings of the 4th international conference on Supercomputing

Pages 254 - 266

https://doi.org/10.1145/77726.255163

Published: 01 June 1990 Publication History

Abstract

In the past three years, the Perfect Benchmark^TM Suite has evolved from a supercomputer performance evaluation plan, presented by Kuck and Sameh at the 1987 International Conference on Supercomputing, to a vigorous international activity. This paper surveys the current state of this supercomputer performance evaluation effort with particular focus on the adopted methodology. While there has been considerable success in achieving the goals of the plan, some issues remain unresolved, and new questions have surfaced.

References

[1]

D. BAILEY AND J. BARTON, The NAS Kernel Benchmark Program, Tech. Rep. 86711, NASA Ames Technical Memorandum, 1985.

[2]

M. BERRY ET AL., The Perfect Club Benchmarks: Effective Performance Evaluation of Supercomputers, The International Journal of Supercomputer Applications, 3 (1989), pp. 5- 40.

[3]

H. CURNOW AND B. WICHMAN, A Synthetic Benchmark~ Comput. :I., 19 (1976), pp. 43-49.

[4]

G.CYBENKO,Networking Pee- 965, Center for Supercomputing Research and Development, University of illinois at Urbana, Technical Report, 1990.

[5]

J. DONGARRA, Performance of Various Computers Using Standard Linear Equations Softwave in a Fortran Environment, Tech. Rep. 23, Argonne National Lab Technical Report, 1988.

[6]

J. DONGARRA, J, MARTIN, AND J. WORL- TON, Computer Benchmarking: Paths and Pitfalls, IEEE Spectrum, (1987).

Digital Library

[7]

R. H. HILL, The Art of Benchmarking, The Spang Robinson Report on Supercomputing and Parallel Processing, 3 (1989).

[8]

P. F. Koss, Application Performance on Supercomputers, Tech. Rep. 847, Center for Supercomputing Research and Development, University of Illinois, January 1989.

[9]

D. J. KucK AND A. H. SAMEH, 21 gupercomputing Performance Evaluation Plan, Tech. Rep. 692, Center for Supercomputing Research and Development, University of Illinois, June 1987.

[10]

A. MAZONY, Performance Measurement Intrusion and Perturbation Analysis, Tech. R.ep. 923, Center for Supercomputing Research and Development, University of Illinois at Urbana, Technical Report, 1990.

[11]

F. McMAI~ON, The Livermore Fortran Kernels: A Test of the Numerical Performance Range, tech. rep., Lawrence Livermore Lab, 1986.

[12]

P. MESSlNA ST AL., Benchmarking Advanced Architecture Computers, Tech. Rep. C3P712, Caltech Concurrent Supercomputing Facility, June 1989.

[13]

L. POINTER, Perfect: Performance Evaluation foe Cost Effective Transformations: Report 2, Tech. Rep. 964, Center for Supercomputing Research and Development, University of Illinois at Urbana, Technical Report, 1990.

[14]

R. SAAVEDRA-BARRERA, A. SMITH, AND E. MIYA, Machine Characterization Based on an Abstract High-Level Language Machine, IEEE Trans. on Computers, 38 (1989), pp. 1659-1679.

Digital Library

[15]

J. E. SMX'rH, Charactevizin9 Computer Per- (1988).

[16]

J. UNIEJEWSKI, SPEC Benchmark Suite: Designed for Today's Advanced Systems. SPEC Newsletter, Fall 1989. Volttme 1, Issue 1.

[17]

J. WORLTON, Understanding Supercomputer Benchmarks, Datamation, (1984), pp. 121- 129.

Cited By

Bailey DBarszcz EBarton JBrowning DCarter RDagum LFatoohi RFrederickson PLasinski TSchreiber RSimon HVenkatakrishnan VWeeratunga S(2016)The Nas Parallel BenchmarksThe International Journal of Supercomputing Applications10.1177/1094342091005003065:3(63-73)Online publication date: 16-Sep-2016
https://doi.org/10.1177/109434209100500306
Kennedy KMcKinley K(2014)Optimizing for parallelism and data localityACM International Conference on Supercomputing 25th Anniversary Volume10.1145/2591635.2667164(151-162)Online publication date: 10-Jun-2014
https://dl.acm.org/doi/10.1145/2591635.2667164
Awan MJarvis S(2012)MalikStone — A context-aware light-weight benchmark for P2P computing2012 International Conference on High Performance Computing & Simulation (HPCS)10.1109/HPCSim.2012.6266936(350-356)Online publication date: Jul-2012
https://doi.org/10.1109/HPCSim.2012.6266936
Show More Cited By

Index Terms

Recommendations

Supercomputer performance evaluation and the Perfect Benchmarks
Special Issue: Proceedings of the 4th international conference on Supercomputing

In the past three years, the Perfect Benchmark^TM Suite has evolved from a supercomputer performance evaluation plan, presented by Kuck and Sameh at the 1987 International Conference on Supercomputing, to a vigorous international activity. This paper ...
Performance evaluation of supercomputers using HPCC and IMB benchmarks
IPDPS'06: Proceedings of the 20th international conference on Parallel and distributed processing

The HPC Challenge (HPCC) benchmark suite and the Intel MPI Benchmark (IMB) are used to compare and evaluate the combined performance of processor, memory subsystem and interconnect fabric of five leading supercomputers - SGI Altix BX2, Cray X1, Cray ...
Performance evaluation of supercomputers using HPCC and IMB Benchmarks

The HPC Challenge (HPCC) Benchmark suite and the Intel MPI Benchmark (IMB) are used to compare and evaluate the combined performance of processor, memory subsystem and interconnect fabric of five leading supercomputers-SGI Altix BX2, Cray X1, Cray ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICS '90: Proceedings of the 4th international conference on Supercomputing

June 1990

492 pages

ISBN:0897913698

DOI:10.1145/77726

Chairmen:
Ahmed Sameh
Univ. of Illinois
,
Henk van der Vorst
Delft Univ. of Technology and CWI, The Netherlands

ACM SIGARCH Computer Architecture News Volume 18, Issue 3b
Special Issue: Proceedings of the 4th international conference on Supercomputing
Sept. 1990
489 pages
ISSN:0163-5964
DOI:10.1145/255129
Chairmen:
Ahmed Sameh
Univ. of Illinois at Urbana-Champaign, Urbana
,
Henk van der Vorst
Delft Univ. of Technology and CWI, The Netherlands
Issue’s Table of Contents

Copyright © 1990 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1990

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

IC'90

Sponsor:

SIGARCH

IC'90: ACM SIGARCH International Conference on Supercomputing

June 11 - 15, 1990

Amsterdam, The Netherlands

Acceptance Rates

Overall Acceptance Rate 629 of 2,180 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

77
Total Citations
View Citations
1,024
Total Downloads

Downloads (Last 12 months)148
Downloads (Last 6 weeks)18

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bailey DBarszcz EBarton JBrowning DCarter RDagum LFatoohi RFrederickson PLasinski TSchreiber RSimon HVenkatakrishnan VWeeratunga S(2016)The Nas Parallel BenchmarksThe International Journal of Supercomputing Applications10.1177/1094342091005003065:3(63-73)Online publication date: 16-Sep-2016
https://doi.org/10.1177/109434209100500306
Kennedy KMcKinley K(2014)Optimizing for parallelism and data localityACM International Conference on Supercomputing 25th Anniversary Volume10.1145/2591635.2667164(151-162)Online publication date: 10-Jun-2014
https://dl.acm.org/doi/10.1145/2591635.2667164
Awan MJarvis S(2012)MalikStone — A context-aware light-weight benchmark for P2P computing2012 International Conference on High Performance Computing & Simulation (HPCS)10.1109/HPCSim.2012.6266936(350-356)Online publication date: Jul-2012
https://doi.org/10.1109/HPCSim.2012.6266936
Topham NMcDougall K(2006)Performance of the decoupled ACRI-1 architecture: The perfect clubHigh-Performance Computing and Networking10.1007/BFb0046669(472-480)Online publication date: 2-Feb-2006
https://doi.org/10.1007/BFb0046669
Stoltz EWolfe M(2005)Detecting value-based scalar dependenceLanguages and Compilers for Parallel Computing10.1007/BFb0025879(186-200)Online publication date: 9-Jun-2005
https://doi.org/10.1007/BFb0025879
Nguyen TVaswani RZahorjan J(2005)Parallel application characterization for multiprocessor scheduling policy designJob Scheduling Strategies for Parallel Processing10.1007/BFb0022294(175-199)Online publication date: 15-Jun-2005
https://doi.org/10.1007/BFb0022294
Voevodin VVoevodin V(2005)The V-Ray technology of optimizing programs to parallel computersNumerical Analysis and Its Applications10.1007/3-540-62598-4_136(546-556)Online publication date: 3-Jun-2005
https://doi.org/10.1007/3-540-62598-4_136
Havlak P(2005)Construction of thinned gated single-assignment formLanguages and Compilers for Parallel Computing10.1007/3-540-57659-2_28(477-499)Online publication date: 31-May-2005
https://doi.org/10.1007/3-540-57659-2_28
Kennedy KMcKinley K(2005)Maximizing loop parallelism and improving data locality via loop fusion and distributionLanguages and Compilers for Parallel Computing10.1007/3-540-57659-2_18(301-320)Online publication date: 31-May-2005
https://doi.org/10.1007/3-540-57659-2_18
Lee YRyder B(2005)Parallel hybrid data flow algorithms: A case studyLanguages and Compilers for Parallel Computing10.1007/3-540-57502-2_54(296-310)Online publication date: 3-Jun-2005
https://doi.org/10.1007/3-540-57502-2_54
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents