Abstract
This research is to design a collection of effective collective operations for the Grid scale network environment. In the Grid, several network features should be specified and adapted into the algorithmic design of collective operations. For this, we characterize the Grid and design hierarchical latency optimal tree algorithm for the MPI (message passing interface) library. The experimental results show that performance gain in performing collective operations can be achieved by around 160% compared with MPICH-G2 which is based on the flat algorithm.
Chapter PDF
References
M. Bernaschi and G. Iannello. Collective Communication Operations: Experimental Results vs. Theory, Concurrency: Paractice and Experience, 10(5), (1998), 359–386.
T. Kielmann, H. E. Bal and S. Gorlatch, Bandwidth-efficient Collective Communication for Clustered Wide Area Systems, In proc. International Parallel and Distributed Processing Symposium, Mexico, (2000), 492–499.
T. Kielmann, R. F. H. Hofman, H. E. Bal, A. Plaat, and R. A. F. Bhoedjang, MagPIe: MPI’s Collective Communication Operations for Clustered Wide Area Systems, In Proc. Symposium on Principles and Practice of Parallel Programming, Atlanta, GA, 5 (1999), 131–140.
D. Culler, R. Karp, D. Patterson, A. Sahay, K.E. Schauers, E. Santos, R. Subramonian and T. von Eicken. LogP: Towards a Realistic Model of Parallel Computation, In Proc. Symposium on Principles and Practice of Parallel Programming, CA, 5 (1993), 1–12.
I. Foster and N. Karonis, A grid-enabled MPI: Message passing in heterogeneous distributed computing systems, In Proc. Supercomputing’ 98, 11 (1998).
N. Karonis, B. de Supinski, I. Foster, W. Gropp E. Lusk, and J. Bresnahan, Exploiting hierarchy in parallel computer networks to optimize collective operation performance, In Proc. International Parallel and Distributed Processing Symposium, (2000).
I. Foster and C. Kesselman, eds. The GRID: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, (1998).
I. Foster and C. Kesselman, “Globus: A metacomputing infrastructure toolkit”, International Journal of Supercomputer Applications, 11(2), (1997), 115–128.
Message Passing Interface Forum, MPI: A Message-Passing Interface standard, International Journal of Supercomputer Applications, 8(3/4), (1994), 165–414.
MPICH-G2, Online at http://www3.niu.edu/mpi/.
P.B. Bhat, C.S. Raghavendra, and Viktor K. Prasanna, Efficient Collective Communication in Distributed Heterogeneous Systems, International Conference on Distributed Computing Systems, 5 (1999).
Network Weather Service, Online at http://nws.cs.ucsb.edu/.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, KL. et al. (2003). An Efficient Collective Communication Method for Grid Scale Networks. In: Sloot, P.M.A., Abramson, D., Bogdanov, A.V., Gorbachev, Y.E., Dongarra, J.J., Zomaya, A.Y. (eds) Computational Science — ICCS 2003. ICCS 2003. Lecture Notes in Computer Science, vol 2660. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44864-0_84
Download citation
DOI: https://doi.org/10.1007/3-540-44864-0_84
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40197-1
Online ISBN: 978-3-540-44864-8
eBook Packages: Springer Book Archive