Article

Scaling physics and material science applications on a massively parallel Blue Gene/L system

ICS '05: Proceedings of the 19th annual international conference on Supercomputing

Pages 246 - 252

Published: 20 June 2005 Publication History

Abstract

Blue Gene/L represents a new way to build supercomputers, using a large number of low power processors, together with multiple integrated interconnection networks. Whether real applications can scale to tens of thousands of processors (on a machine like Blue Gene/L) has been an open question. In this paper, we describe early experience with several physics and material science applications on a 32,768 node Blue Gene/L system, which was installed recently at the Lawrence Livermore National Laboratory. Our study shows some problems in the applications and in the current software implementation, but overall, excellent scaling of these applications to 32K nodes on the current Blue Gene/L system. While there is clearly room for improvement, these results represent the first proof point that MPI applications can effectively scale to over ten thousand processors. They also validate the scalability of the hardware and software architecture of Blue Gene/L.

References

[1]

N. R. Adiga et al. An overview of the BlueGene/L supercomputer. In SC2002 - High Performance Networking and Computing, Baltimore, MD, November 2002.

Digital Library

Google Scholar

[2]

S. Habata, M. Yokokawa, S. Kitawaki. The Earth Simulator. In NEC Research and Development, 44(1), January 2003.

Google Scholar

[3]

ASC Purple: Fifth Generation ASC Platform. http://www.llnl.gov/asci/platforms/purple/.

Google Scholar

[4]

NASA Columbia Supercomputer. http://www.nasa.gov/centers/ames/research/lifeonearth/lifeon earth-projectColumbia.html.

Google Scholar

[5]

G. Almasi, R. Bellofatto, J. Brunheroto, C. Cascaval, J. Castaños, L. Ceze, P. Crumley, C. Erway, J. Gagliano, D. Lieber, X. Martorell, J. Moreira, A. Sanomiya, and K. Strauss. An Overview of the BlueGene/L System Software Organization (Distinguished Paper). Proceedings of the 2003 International Conference on Parallel and Distributed Computing (Euro-Par 2003). August 26-29, 2003. Klagenfurt, Austria. pp. 543--555.

Google Scholar

[6]

G. Almasi, S. Chatterjee, A. Gara, J. Gunnels, M. Gupta, A. Henning, J. Moreira, B. Walkup, A. Curioni, C. Archer, L. Bachega, B. Chan, B. Curtis, S. Brunett, G. Chukkapalli, R. Harkness, W. Pfeiffer. Unlocking the Performance of the BlueGene/L Supercomputer, SC 2004: High Performance Computing, Networking and Storage Conference, Pittsburgh, PA, November 2004.

Digital Library

Google Scholar

[7]

F. Petrini, D. Kerbyson and S. Pakin. The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8,192 Processors of ASCI Q. In IEEE/ACM SC2003, Phoenix, AZ, November 2003.

Digital Library

Google Scholar

[8]

TOP500 Supercomputer Sites, http://www.top500.org.

Google Scholar

[9]

L. Bachega, S. Chatterjee, K. Dockser, J. Gunnels, M. Gupta, F. Gustavson, C. Lapkowski, G. Liu, M. Mendell, C. Wait, T. J. C. Ward. A High-Performance SIMD Floating Point Unit Design for BlueGene/L: Architecture, Compilation, and Algorithm Design. Parallel Architecture and Compilation Techniques (PACT 2004), Antibes Juan-les-Pins, France, Sept-Oct 2004.

Digital Library

Google Scholar

[10]

K. Davis, A. Hoisie, G. Johnson, D. Kerbyson, M. Lang, S. Pakin and F. Petrini. A Performance and Scalability Analysis of the BlueGene/L Architecture. In IEEE/ACM SC2004, Pittsburgh, PA, November 2004.

Digital Library

Google Scholar

[11]

G. Almasi, C. Archer, J. Castanos, C. Erway, J. Gunnels, P. Heidelberger, X. Martorell, J. Moreira, K. Pinnow, J. Ratterman, B. Steinmacher-burow, W. Gropp, B. Toonen. Design and implementation of message passing services for the BlueGene/L supercomputer. IBM Journal of Research and Development, No 2/3, 2005.

Digital Library

Google Scholar

[12]

A. Eichenberger, P. Wu, and K. O'Brien. Vectorizing for Short SIMD Architectures with Alignment Constraints. ACM SIGPLAN conference of Programming Languages Design and Implementation (PLDI'04), Washington DC, June, 2004.

Digital Library

Google Scholar

[13]

P. Wu, A. Eichenberger, and A. Wang. Efficient Code Generation for Runtime Alignment and Length Conversion. Code Generation and Optimization (CGO'05), March, 2005.

Digital Library

Google Scholar

Cited By

View all

Mustafa D(2022)Performance Evaluation of Massively Parallel Systems Using SPEC OMP SuiteComputers10.3390/computers1105007511:5(75)Online publication date: 5-May-2022
https://doi.org/10.3390/computers11050075
Chatelain PCurioni ABergdorf MRossinelli DAndreoni WKoumoutsakos P(2008)Billion vortex particle direct numerical simulations of aircraft wakesComputer Methods in Applied Mechanics and Engineering10.1016/j.cma.2007.11.016197:13-16(1296-1304)Online publication date: Feb-2008
https://doi.org/10.1016/j.cma.2007.11.016
Chung IWalkup RWen HYu H(2006)A study of MPI performance analysis tools on blue gene/LProceedings of the 20th international conference on Parallel and distributed processing10.5555/1898699.1898926(366-366)Online publication date: 25-Apr-2006
https://dl.acm.org/doi/10.5555/1898699.1898926
Show More Cited By

Index Terms

Scaling physics and material science applications on a massively parallel Blue Gene/L system
1. Applied computing
  1. Physical sciences and engineering

Recommendations

Optimization of MPI collective operations on the IBM Blue Gene/Q supercomputer

The Blue Gene/Q (BG/Q) machine is the latest in the line of IBM massively parallel supercomputers, designed to scale to 262,144 nodes and 16 million threads. Each BG/Q node has 68 hardware threads. Hybrid programming paradigms, which use message passing ...
Parallel genomic sequence-search on a massively parallel system
CF '07: Proceedings of the 4th international conference on Computing frontiers

In the life sciences, genomic databases for sequence search have been growing exponentially in size. As a result, faster sequence-search algorithms to search these databases continue to evolve to cope with algorithmic time complexity. The ubiquitous ...
Performance characteristics of hybrid MPI/OpenMP implementations of NAS parallel benchmarks SP and BT on large-scale multicore supercomputers
Special issue on the 1st international workshop on performance modeling, benchmarking and simulation of high performance computing systems (PMBS 10)

The NAS Parallel Benchmarks (NPB) are well-known applications with the fixed algorithms for evaluating parallel systems and tools. Multicore supercomputers provide a natural programming paradigm for hybrid programs, whereby OpenMP can be used with the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICS '05: Proceedings of the 19th annual international conference on Supercomputing

June 2005

414 pages

ISBN:1595931678

DOI:10.1145/1088149

General Chair:
Arvind
MIT
,
Program Chair:
Larry Rudolph
MIT

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICS05

Sponsor:

SIGARCH

ICS05: International Conference on Supercomputing 2005

June 20 - 22, 2005

Massachusetts, Cambridge

Acceptance Rates

Overall Acceptance Rate 629 of 2,180 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
680
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Mustafa D(2022)Performance Evaluation of Massively Parallel Systems Using SPEC OMP SuiteComputers10.3390/computers1105007511:5(75)Online publication date: 5-May-2022
https://doi.org/10.3390/computers11050075
Chatelain PCurioni ABergdorf MRossinelli DAndreoni WKoumoutsakos P(2008)Billion vortex particle direct numerical simulations of aircraft wakesComputer Methods in Applied Mechanics and Engineering10.1016/j.cma.2007.11.016197:13-16(1296-1304)Online publication date: Feb-2008
https://doi.org/10.1016/j.cma.2007.11.016
Chung IWalkup RWen HYu H(2006)A study of MPI performance analysis tools on blue gene/LProceedings of the 20th international conference on Parallel and distributed processing10.5555/1898699.1898926(366-366)Online publication date: 25-Apr-2006
https://dl.acm.org/doi/10.5555/1898699.1898926
Agerwala TGupta M(2006)Systems research challengesIBM Journal of Research and Development10.1147/rd.502.017350:2/3(173-180)Online publication date: 1-Mar-2006
https://dl.acm.org/doi/10.1147/rd.502.0173
Chung IWalkup RWen HYu HHorner-Miller B(2006)MPI performance analysis tools on Blue Gene/LProceedings of the 2006 ACM/IEEE conference on Supercomputing10.1145/1188455.1188583(123-es)Online publication date: 11-Nov-2006
https://dl.acm.org/doi/10.1145/1188455.1188583
Chung IWalkup RWen HYu H(2006)MPI Performance Analysis Tools on Blue Gene/LACM/IEEE SC 2006 Conference (SC'06)10.1109/SC.2006.43(16-16)Online publication date: Nov-2006
https://doi.org/10.1109/SC.2006.43
Almasi GBhanot GChen DEleftheriou MFitch BGara AGermain RGunnels JGupta MHeidelberg PPitman MRayshubskiy ASexton JSuits FVranas PWalkup BWard CZhestkov YCurioni AAndreoni WArcher CMoreira JLoft RTufo HVoran TRiley K(2005)Early experience with scientific applications on the blue gene/l supercomputerProceedings of the 11th international Euro-Par conference on Parallel Processing10.1007/11549468_63(560-570)Online publication date: 30-Aug-2005
https://dl.acm.org/doi/10.1007/11549468_63

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Optimization of MPI collective operations on the IBM Blue Gene/Q supercomputer

Parallel genomic sequence-search on a massively parallel system

Performance characteristics of hybrid MPI/OpenMP implementations of NAS parallel benchmarks SP and BT on large-scale multicore supercomputers