More Web Proxy on the site http://driver.im/

Article

SMP system interconnect instrumentation for performance analysis

Authors:

Lisa Noordergraaf,

Robert ZakAuthors Info & Claims

SC '02: Proceedings of the 2002 ACM/IEEE conference on Supercomputing

Pages 1 - 9

Published: 16 November 2002 Publication History

Abstract

The system interconnect is often the performance bottleneck in SMP computers. Although modern SMPs include event counters on processors and interconnects, these provide limited information about the interaction of processors vying for shared resources. Additionally, transaction sources and addresses are not readily available, making analysis of access patterns and data locality difficult. Enhanced system interconnect instrumentation is required to extract this information.This paper describes instrumentation implemented for monitoring the system interconnect on Sun Fire™ servers. The instrumentation supports sophisticated programmable filtering of event counters, allowing us to construct histograms of system interconnect activity, and a FIFO to capture trace sequences. Our implementation results in a very small hardware footprint, making it appropriate for inclusion in commodity hardware.We also describe a sampling of software tools and results based on this infrastructure. Applications have included performance profiling, architectural studies, and hardware brin-gup and debugging.

References

[1]

R. A. Uhlig and T. N. Mudge, "Trace-Driven Memory Simulation: A Survey," ACM Computing Surveys, Vol. 29, No. 2, June 1997.]]

Digital Library

[2]

P. S. Magnusson, M. Christensson, J. Eskilson, D. Forsgren, G. Hållberg, J. Högberg, F. Larsson, A. Moestedt, B. Werner, "Simics: A Full System Simulation Platform," IEEE Computer, February 2002, pp. 50--58.]]

Digital Library

[3]

S. J. Sistare, C. J. Jackson, "Ultra-High Performance Communication with MPI and the Sun Fire Link Interconnect," Proceedings of Supercomputing 2002, Nov. 2002.]]

Digital Library

[4]

A. Charlesworth, "The Sun Fireplane system interconnect." In Proceedings of SC2001, Nov. 2001.]]

Digital Library

[5]

.V. Aslot, M. Domeika, R. Eigenmann, G. Gaertner, W. B. Jones, and B. Parody, "SPEComp: A new benchmark suite for measuring parallel computer performance," Workshop on OpenMP Applications and Tools, WOMPAT 2001, Lecture Notes in Computer Science, vol. 2104, pp. 1--10, 2001.]]

Digital Library

[6]

D. H. Bailey, E. Barszcz, J. Barton, D. Browning, R. Carter, L. Dagum, R. Fatoohi, S. Fineberg, P. Frederickson, T. Lasinski, R. Schreiber, H. Simon, V. Venkatakrishnan, and S. Weeratunga, "The NAS Parallel Benchmarks," Technical Report RNR-94-007, NASA Ames Research Center, 1994.]]

[7]

"busstat(1M)", Solaris 8 Reference Manual Collection, man pages section 1M: System Administration Commands. Sun Microsystems. {Online}. Available: http://docs.sun.com]]

[8]

B.R. Buck and J. K. Hollingsworth, "Using hardware performance monitors to isolate memory bottlenecks," Proceedings of Supercomputing 2000, Nov. 2000.]]

Digital Library

[9]

J. Hughes and D. Cronshaw,"On usinga hardware monitor as an intelligent peripheral," Performance Evaluation Review, Vol. 2, No.4, December 1973.]]

Digital Library

[10]

J. S. Emer and D. W. Clark, "A characterization of processor performance in the VAX-11/780," in Proceedings of the 11th Annual International Symposium on Computer Architecture, 1984, pp. 301--310.]]

Digital Library

[11]

D. W. Clark, P. J. Bannon, and J. B. Keller, "Measuring VAX 8800 performance with a histogram hardware monitor,"in Proceedings of the 15th Annual International Symposium on Computer Architecture, 1988, pp. 176--185.]]

Digital Library

[12]

D. Lenoski, J. Laudon, K. Gharachorloo, W. Weber, A. Gupta, J. Hennessy, M. Horowitz, M. Lam, "The Stanford Dash Multiprocessor", IEEE Computer, Vol. 25, No. 3, March 1992.]]

Digital Library

[13]

D. Lenoski, J. Laudon, T. Joe, D. Nakahira, L. Stevens, A. Gupta, J. Hennessy, "The DASH Prototype: Logic Overhead and Performance," IEEE Transactions on Parallel and Distributed Systems, Vol. 4, No. 1, pp. 41--61, January 1993.]]

Digital Library

[14]

M. Martinosi, D. W. Clark, and M. Mesarina, "The SHRIMP performance monitor: Design and applications," in Proceedings of SIGMETRICS Symposium on Parallel and Distributed Tools, 1996, pp. 61--69.]]

Digital Library

[15]

W. Karl, M. Leberecht, M. Schulz, "Supporting shared memory and message passing on clusters of PCs with SMiLE", CANPC '99, (together with HPCA-5), 1999. Published in Lecture Notes in Computer Science, vol. 1602, Heidelberg:Springer Verlag.]]

Digital Library

[16]

R. Hockauf, W. Karl, M. Leberecht, M. Oberhuber, and M. Wagner, "Exploiting spatial and temporal locality of accesses: A new hardware-based monitoring approach for DSM Systems," in Proceedings EuroPar '98, 1998.]]

Digital Library

[17]

Jie Tao, Wolfgang Karl, and Martin Schulz, "Visualizing the Memory Access Features of Shared Memory Applications on NUMA Architectures," in Proceedings of the 2001 International Conference on Computational Science (ICCS), 2001, pp. 861--870.]]

Digital Library

Cited By

Azimi RTam DSoares LStumm M(2009)Enhancing operating system support for multicore processors by using hardware performance monitoringACM SIGOPS Operating Systems Review10.1145/1531793.153180343:2(56-65)Online publication date: 21-Apr-2009
https://dl.acm.org/doi/10.1145/1531793.1531803
Berg EHagersten E(2005)Fast data-locality profiling of native executionACM SIGMETRICS Performance Evaluation Review10.1145/1071690.106423233:1(169-180)Online publication date: 6-Jun-2005
https://dl.acm.org/doi/10.1145/1071690.1064232
Collard JJouppi NYehia SPingali KYelick KGrimshaw A(2005)System-wide performance monitors and their application to the optimization of coherent memory accessesProceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming10.1145/1065944.1065977(247-254)Online publication date: 15-Jun-2005
https://dl.acm.org/doi/10.1145/1065944.1065977
Show More Cited By

Index Terms

Recommendations

The Starfire SMP interconnect
SC '97: Proceedings of the 1997 ACM/IEEE conference on Supercomputing

The Starfire interconnect extends the envelope of Unix symmetric multiprocessor (SMP) systems in several dimensions. Interconnect: an active centerplane with four address routers and a 16x16 data crossbar provides 64 UltraSPARC processors with uniform ...
Overcoming performance bottlenecks in using OpenMP on SMP clusters

This paper presents a new parallel programming environment called ParADE to enable easy, portable, and high-performance computing for SMP clusters. Different from the prior studies, ParADE separates the programming model from the execution model: it ...
SeaStar Interconnect: Balanced Bandwidth for Scalable Performance

The SeaStar, a new ASIC from Cray, is a full system-on-chip design that integrates high-speed serial links, a 3D router, and traditional network interface functionality, including an embedded processor in a single chip.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '02: Proceedings of the 2002 ACM/IEEE conference on Supercomputing

November 2002

952 pages

ISBN:076951524X

Conference Chair:
Roscoe Giles
Boston University
,
Program Chair:
Daniel Reed
NCSA
,
Publications Chair:
Kathryn Kelley
Ohio Supercomputer Center

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 16 November 2002

Check for updates

Qualifiers

Article

Conference

SC '02

Sponsor:

SIGARCH
IEEE-CS

SC '02: International Conference for High Performance Computing, Networking, Storage and Analysis

16 11 2002

Maryland, Baltimore

Acceptance Rates

SC '02 Paper Acceptance Rate 67 of 230 submissions, 29%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
326
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Azimi RTam DSoares LStumm M(2009)Enhancing operating system support for multicore processors by using hardware performance monitoringACM SIGOPS Operating Systems Review10.1145/1531793.153180343:2(56-65)Online publication date: 21-Apr-2009
https://dl.acm.org/doi/10.1145/1531793.1531803
Berg EHagersten E(2005)Fast data-locality profiling of native executionACM SIGMETRICS Performance Evaluation Review10.1145/1071690.106423233:1(169-180)Online publication date: 6-Jun-2005
https://dl.acm.org/doi/10.1145/1071690.1064232
Collard JJouppi NYehia SPingali KYelick KGrimshaw A(2005)System-wide performance monitors and their application to the optimization of coherent memory accessesProceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming10.1145/1065944.1065977(247-254)Online publication date: 15-Jun-2005
https://dl.acm.org/doi/10.1145/1065944.1065977
Berg EHagersten EEager DWilliamson CBorst SLui J(2005)Fast data-locality profiling of native executionProceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems10.1145/1064212.1064232(169-180)Online publication date: 6-Jun-2005
https://dl.acm.org/doi/10.1145/1064212.1064232
Tikir MHollingsworth J(2005)NUMA-Aware Java Heaps for Server ApplicationsProceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 0110.1109/IPDPS.2005.299Online publication date: 4-Apr-2005
https://dl.acm.org/doi/10.1109/IPDPS.2005.299
Tikir MHollingsworth JHuskamp J(2004)Using Hardware Counters to Automatically Improve Memory PerformanceProceedings of the 2004 ACM/IEEE conference on Supercomputing10.1109/SC.2004.64Online publication date: 6-Nov-2004
https://dl.acm.org/doi/10.1109/SC.2004.64
Sistare SJackson CGiles RReed DKelley K(2002)Ultra-high performance communication with MPI and the Sun fire™ link interconnectProceedings of the 2002 ACM/IEEE conference on Supercomputing10.5555/762761.762774(1-15)Online publication date: 16-Nov-2002
https://dl.acm.org/doi/10.5555/762761.762774

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten