Abstract
We review fast networking technologies for both wide-area and high performance cluster computer systems. We describe our experiences in constructing asynchronous transfer mode (ATM)-based local- and wide-area clusters and the tools and technologies this experience led us to develop. We discuss our experiences using Internet Protocol on such systems as well as native ATM protocols and the problems facing wide-area integration of cluster systems. We are presently constructing Beowulf-class computer clusters using a mix of Fast Ethernet and Gigabit Ethernet technology and we anticipate how such systems will integrate into a new local-area Gigabit Ethernet network and what technologies will be used for connecting shared HPC resources across wide-areas. High latencies on wide-area cluster systems led us to develop a metacomputing problem-solving environment known as distributed information systems control world (DISCWorld). We summarize our main developments in this project as well as the key features and research directions for software to exploit computational services running on fast networked cluster systems.
Similar content being viewed by others
References
ATM Forum. Available at http://www.atmforum.com Last visitedDecember 1999.
N. Boden, R. Felderman, A. Kulawik, C. Seitz, J. Seizovic, and W. Su. Myrinet — A gigabit per secondlocal area network. IEEE Micro, 15 (1):29–36, February 1995.
R. Buyya, M. Baker, K. Hawick, and H. James, eds,Proc. First IEEE Computer Society International Workshop on Cluster Computing (IWCC '99), IEEE Computer Society, December 1999, ISBN 0–7695-0343-8.
CASA Project. The CASA Gigabit TestbedProject. Available at http://www.nlanr.net/CASA/casa.html Last visited December 1999.
P. D. Coddington, K. A. Hawick, and H. A. James. Web-based access to distributed, high-performance geographic information systems for decision support. Technical report DHPC-037, Advanced Computational Systems CRC, Department of Computer Science, University of Adelaide, June 1998.
W. J. Cronin, J. D. Hutchinson, K. K. Ramakrishnan, and H. Yang. A comparison of high speed LANs. In Proc. IEEE 9th Conf. on Local Computer Networks (LCN), October 1994.
I. Foster and C. Kesselman. The Grid: Blueprint for a New Computing Infrastructure, Morgan Kauf-mann, Los Altos, CA,1999, ISBN 1–55860-475-8.
A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, and V. Sunderam. PVM: Parallel Virtual Machine A Users 'guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge, MA, 1994.
Gigabit Ethernet Alliance. Gigabit Ethernet Alliance. Available at http://www.gigabit-ethernet.org/ Last visitedDecember 1999.
A. S. Grimshaw and W. A. Wulf. Legion —A view from 50,000 feet. In Proc. Fifth IEEE Int. Symp. High Performance Distributed Computing, Los Alamos, CA, August 1996. IEEE Computer Society Press, Silver Spring, MD.
IEEE Standards On-line. IEEE Standard 802.3u Fast Ethernet Standard Available at http://standards.ieee.org Last visited December 1999.
IEEE Standards On-Line. IEEE Standard 1596 Scalable Coherent Interface (SCI). Available at http://standard.ieee.org Last visited December 1999.
K. A. Hawick. Meta-Cluster Computing. DHPC-074, Computer Science Department, The University of Adelaide, November 1999.
K. A. Hawick, H. A. James, K. J. Maciunas, F. A. Vaughan, A. L. Wendelborn, M. Buchhorn, M. Rezny, S. R. Taylor, and M. D. Wilson. Geographic information systems applications on an ATM-based distributed high performance computing system. In Proceedings HPCN '97, Vienna, Austria, August 1997a.
K. A. Hawick, H. A. James, K. J. Maciunas, F. A. Vaughan, A. L. Wendelborn, M. Buchhorn, M. Rezny, S. R. Taylor, and M. D. Wilson. Geostationary-satellite imagery applications on distributed, high-performance computing. In Proc. HPCAsia '97, August 1997b.
K. A. Hawick, H. A. James, A. J. Silis, D. A. Grove, K. E. Kerry, J. A. Mathew, P. D. Coddington, C. J. Patten, J. F. Hercus, and F. A. Vaughan. DISC World: An environment for service-based metacomputing. Future Generation Computing Systems (FGCS), 15623–635, 1999.
High Performance Fortran Forum (HPFF). High Performance Fortran Language Specification. Available from http://www.crpc.rice.edu/HPFF/.
Internet Engineering Task Force. IPv6 Standard. Available from http://www.ietf.org.
H.A. James. Scheduling in metacomputing systems. Ph.D. Thesis, Department of Computer Science, The University of Adelaide, July 1999.
H. A. James. Using ATM in distributed applications. Honours Thesis, Department of Computer Science, The University of Adelaide, 1995.
D. Kirkham. Telstra 's experimental broadband network. Telecommunications J. Australia, 45 (2):1995.
C. Krumann and T. Stricker. A comparison of two Gigabit SAN/LAN technologies: Scalable Coherent Interface and Myrinet. In Proc. SCI Europe, EMMSEC '98, September 1998.
J. Mache. An assessment of Gigabit Ethernet as cluster interconnect. In Proc. IEEE Computer Society International Workshop on Cluster Computing (IWCC '99), December 1999.
J. A. Mathew and K. A. Hawick. ATM performance characteristics on distributedhigh performance computers. Technical report DHPC-016, Computer Science Department, University of Adelaide, 1997.
Message Passing Interface Forum. MPI: A Message Passing Interface Standard. Available from http://www.mpi-forum.org.
S. Hariri and G. Fox. Applications andenabling technology for NYNET upstate corridor. Technical report 642, Northeast Parallel Architectures Center, Syracuse University, November 1994.
Object Management Group. CORBA/IIOP 2.2 Specification. Available from http://www.-omg.org/ corba/cichpter.html, July 1998.
S. Sekiguchi, M. Sato, H. Nakada, and U. Nagashima. — Ninf —: Network base information library for globally high performance computing. In Parallel Object-Oriented Methods and Applications (POOMA), February 1996.
B. Tolley,3Com Corporation. The Lowdown on High Speed: Gigabit Ethernet. Available at http://www.3com.com/technology/layer3sw2/layer3sw2c.html.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hawick, K.A., James, H.A. Asynchronous Transfer Mode and other Network Technologies for Wide-Area and High-Performance Cluster Computing. The Journal of Supercomputing 19, 285–297 (2001). https://doi.org/10.1023/A:1011182631841
Issue Date:
DOI: https://doi.org/10.1023/A:1011182631841