Abstract
For an increasing number of data intensive scientific applications, parallel I/O concepts are a major performance issue. Tackling this issue, we provide an outline of an input/output system designed for highly efficient, scalable and conveniently usable parallel I/O on distributed memory systems. The main focus of this paper is the parallel I/O runtime system support provided for software-generated programs produced by parallelizing compilers in the context of High Performance FORTRAN efforts. Specifically, our design is presented in the context of the Vienna Fortran Compilation System.
The work described in this paper is being carried out as part of the research project “Language, Compiler and Advanced Data Structure Support for Parallel I/O Operations” supported by the Austrian Research Foundation (FWF Grant P11006-MAT).
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
S. Benkner. Vienna Fortran 90 and its Compilation. Ph.D. Thesis, University of Vienna, September, 1994.
S. Benkner et al. Vienna Fortran Compilation System — Version 1.2 — User's Guide, University of Vienna, October 1995.
R. Bennett, K. Bryant, A. Sussman, R. Das, and J. Saltz. Jovian: A Framework for Optimizing Parallel I/O. In Proceedings of the 1994 Scalable Parallel Libraries Conference, IEEE Computer Society Press, Oct. 1994
P. Brezany, T. Mueck, E. Schikuta. Language, Compiler and Parallel Database Support for I/O Intensive Applications. Proc. HPCN Europe 1996, Milan, Italy, May 1995, Springer-Verlag, pp. 14–20.
P. Brezany, T. Mück, and E. Schikuta: Mass storage support for a parallelizing compilation system. In Proceedings of the Conference EUROSIM — HPCN Challenges 1996, North Holland, Elsevier, June 1996.
P. Brezany, T. Mück, and E. Schikuta: A Software Architecture for Massively Parallel Input-Output. Technical Report, Department of Data Engineering, University of Vienna, September 1996.
A. Choudhary et al. PASSION: Parallel And Scalable Software for Input-Output. Technical Report CRPC-TR94483-S, Syracuse University, Syracuse, NY, 1994.
P. F. Corbett, D. G. Feitelson. Design and Implementation of the Vesta Parallel File System. In Proc. Scalable High Performance Computing Conference, Knoxville, May 1994, pp. 63–70.
P. Corbett et al. MPI-IO: A parallel file I/O Interface for MPI. Version 0.3. Technical Report NAS-95-002, NAS, January 1995.
T.C. Mowry. Tolerating Latency Through Software-Controlled Data Prefetching. Ph.D.Thesis, Standford University, March 1994.
S. A. Moyer, V. S. Sunderam. PIOUS: A Scalable Parallel I/O System for Distributed Computing Environments. In Proc. Scalable High Performance Computing Conference, Knoxville, May 1994, pp. 71–78.
High Performance Fortran Forum. High Performance Fortran Language Specification. Scientific Programming, Vol. 2, No. 1, 2, 1993.
Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. April 1994.
K. E. Seamons. Panda: Fast Access to Persistent Arrays Using High Level Interfaces and Server Directed Input/Output. Ph.D.Thesis, University of Illinois at Urbana-Champaign, 1996.
H. Zima, P. Brezany, B. Chapman, P. Mehrotra, and A. Schwald. Vienna Fortran — a Language Specification. ACPC Technical Report Series, University of Vienna, Vienna, Austria, 1992.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brezany, P., Mueck, T.A., Schikuta, E. (1996). A software architecture for massively parallel input-output. In: Waśniewski, J., Dongarra, J., Madsen, K., Olesen, D. (eds) Applied Parallel Computing Industrial Computation and Optimization. PARA 1996. Lecture Notes in Computer Science, vol 1184. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-62095-8_10
Download citation
DOI: https://doi.org/10.1007/3-540-62095-8_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62095-2
Online ISBN: 978-3-540-49643-4
eBook Packages: Springer Book Archive