More Web Proxy on the site http://driver.im/

Article

The Direct Access File System

Authors:

Matt DeBergalis,

Mark WittleAuthors Info & Claims

FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies

Pages 175 - 188

Published: 31 March 2003 Publication History

Abstract

The Direct Access File System (DAFS) is a new, fast, and lightweight remote file system protocol. DAFS targets the data center by addressing the performance and functional needs of clusters of application servers. We call this the local file sharing environment. File access performance is improved by utilizing Direct Access Transports, such as InfiniBand, Remote Direct Data Placement, and the Virtual Interface Architecture. DAFS also enhances file sharing semantics compared to prior network file system protocols. Applications using DAFS through a user-space I/O library can bypass operating system overhead, further improving performance. We present performance measurements of an IP-based DAFS network, demonstrating the DAFS protocol's lower client CPU requirements over commodity Gigabit Ethernet. We also provide the first multiprocessor scaling results for a well-known application (GNU gzip) converted to use DAFS.

References

[1]

InfiniBand Trade Association. Infiniband architecture specification, release 1.0a, June 2001.]]

[2]

Gaurav Banga, Jeffrey C. Mogul, and Peter Druschel. A scalable and explicit event delivery mechanism for UNIX. In USENIX Annual Technical Conference, pages 253-265, June 1999.]]

[3]

Matthias Blumrich, Kai Li, Richard Alpert, Cezary Dubnicki, Edward Felten, and Jonathan Sandberg. Virtual memory mapped network interface for the SHRIMP multicomputer. Proceedings of the 21st Annual Symposium on Computer Architecture, pages 142-153, April 1994.]]

[4]

Nanette J. Boden, Danny Cohen, Robert E. Felderman, Alan E. Kulawik, Charles L. Seitz, Jakov N. Seizovic, and Wen-King Su. Myrinet: A gigabit-per-second local area network. IEEE Micro, 15(1):29-36, 1995.]]

[5]

Greg Buzzard, David Jacobson, Milon Mackey, Scott Marovich, and John Wilkes. An implementation of the Hamlyn sender-managed interface architecture. In Proceedings of the Second Symposium on Operating Systems Design and Implementation. USENIX Association, October 1996.]]

[6]

Abhishek Chandra and David Mosberger. Scalability of Linux event-dispatch mechanisms. In Proceedings of the USENIX Annual Technical Conference, pages 231-244, June 2001.]]

[7]

Jeff Chase, Andrew Gallatin, and Ken Yocum. End system optimizations for high-speed TCP. IEEE Communications Magazine, 39(4):68-74, 2001.]]

[8]

DAFS Collaborative. Direct Access File System: Application programming interface, October 2001.]]

[9]

DAFS Collaborative. Direct Access File System protocol, version 1.0, September 2001.]]

[10]

DAT Collaborative. uDAPL: User Direct Access Programming Library, version 1.0, July 2002.]]

[11]

Compaq, Intel, and Microsoft. Virtual Interface Architecture specification, version 1.0, December 1997.]]

[12]

Brian Pawlowski et al. The NFS version 4 protocol. Proceedings of the 2nd international system administration and networking conference (SANE2000), page 94, 2000.]]

[13]

Internet Engineering Task Force. Remote direct data placement charter.]]

[14]

MPI Forum. MPI-2: Extensions to the message-passing interface, July 1997.]]

[15]

Robert W. Horst. Tnet: A reliable system area network. IEEE Micro, 15(1):37-45, 1995.]]

[16]

John H. Howard, Michael L. Kazar, Sherri G. Menees, David A. Nichols, M. Satyanarayanan, Robert N. Sidebotham, and Michael J. West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51-81, 1988.]]

[17]

Chet Juszczak. Improving the performance and correctness of an NFS server. In USENIX Winter Technical Conference, pages 53-63, January 1989.]]

[18]

Mitsuhiro Kishimoto, Naoshi Ogawa, Takahiro Kurosawa, Keisuke Fukui, Nobuhiro Tachino, Andreas Savva, and Norio Shiratori. High performance communication system for UNIX cluster system. IPSJ Journal Abstract, 41(12 - 020).]]

[19]

John Kohl and B. Clifford Neuman. Internet Engineering Task Force, RFC 1510: The Kerberos network authentication service (v5). September 1993.]]

[20]

Ed Lee and Chandu Thekkath. Petal: Distributed virtual disks. In Proceedings of the International Symposium on Architectural Support for Programming Languages and Operating Systems, pages 84-93, October 1996.]]

[21]

John Linn. Internet Engineering Task Force, RFC 2743: Generic security service application program interface, version 2, update 1, January 2000.]]

[22]

Kostas Magoutis. Design and implementation of a direct access file system. In Proceedings of BSDCon 2002 Conference, 2002.]]

[23]

Kostas Magoutis, Salimah Addetia, Alexandra Fedorova, and Margo Seltzer. Making the most of direct-access network-attached storage. In Proceedings of the Second Conference on File and Storage Technologies (FAST). USENIX Association, March 2003.]]

[24]

Kostas Magoutis, Salimah Addetia, Alexandra Fedorova, Margo Seltzer, Jeff Chase, Richard Kisley, Andrew Gallatin, Rajiv Wickremisinghe, and Eran Gabber. Structure and performance of the Direct Access File System. In USENIX Technical Conference, pages 1-14, June 2002.]]

[25]

Paul R. McJones and Garret F. Swart. Evolving the Unix system interface to support multithreaded programs. Technical Report 21, DEC Systems Research Center, September 1987.]]

[26]

Marshall K. McKusick, William N. Joy, Samuel J. Leffler, and Robert S. Fabry. A fast file system for UNIX. Computer Systems, 2(3):181-197, 1984.]]

[27]

Sun Microsystems. Internet Engineering Task Force, RFC 1094: NFS: Network File System protocol specification, March 1989.]]

[28]

Mendel Rosenblum and John K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems, 10(1):26-52, 1992.]]

[29]

Frank Schmuck and Roger Haskin. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the First Conference on File and Storage Technologies (FAST). USENIX Association, January 2002.]]

[30]

SNIA. Common Internet File System (CIFS) technical reference, revision 1.0. SNIA Technical Proposal.]]

[31]

Robert Snively. FCP draft, revision 8.0. T11 Document X3T11/94-042v0, 1994.]]

[32]

Steve Soltis, Grant Erickson, Ken Preslan, Matthew O'Keefe, and Thomas Ruwart. The Global File System: A file system for shared disk storage. In IEEE Transactions on Parallel and Distributed Systems, October 1997.]]

[33]

Raj Srinivasan. Internet Engineering Task Force, RFC 1831: RPC: Remote Procedure Call protocol specification version 2, August 1995.]]

[34]

Chandramohan A. Thekkath, Timothy Mann, and Edward K. Lee. Frangipani: A scalable distributed file system. In Proceedings of the Sixteenth ACM Symposium on Operating System Principles (SOSP), pages 224-237, October 1997.]]

Cited By

Yang JIzraelevitz JSwanson SMerchant AWeatherspoon H(2019)OrionProceedings of the 17th USENIX Conference on File and Storage Technologies10.5555/3323298.3323319(221-234)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3323298.3323319
Trivedi AIoannou NMetzler BStuedi PPfefferle JKourtis KKoltsidas IGross T(2018)FlashNetACM Transactions on Storage10.1145/323956214:4(1-29)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3239562
Trivedi AIoannou NMetzler BStuedi PPfefferle JKoltsidas IKourtis KGross TChen DDesnoyers Pde Lara E(2017)FlashNetProceedings of the 10th ACM International Systems and Storage Conference10.1145/3078468.3078477(1-14)Online publication date: 22-May-2017
https://dl.acm.org/doi/10.1145/3078468.3078477
Show More Cited By

Index Terms

The Direct Access File System

Recommendations

Improving file system performance with file access predictions
Application performance on the Direct Access File System

The Direct Access File System (DAFS) is a distributed file system built on top of direct-access transports (DAT). Direct-access transports are characterized by using remote direct memory access (RDMA) for data transfer and user-level networking. The ...
The zebra striped network file system

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies

March 2003

273 pages

Publisher

USENIX Association

United States

Publication History

Published: 31 March 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
113
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yang JIzraelevitz JSwanson SMerchant AWeatherspoon H(2019)OrionProceedings of the 17th USENIX Conference on File and Storage Technologies10.5555/3323298.3323319(221-234)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3323298.3323319
Trivedi AIoannou NMetzler BStuedi PPfefferle JKourtis KKoltsidas IGross T(2018)FlashNetACM Transactions on Storage10.1145/323956214:4(1-29)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3239562
Trivedi AIoannou NMetzler BStuedi PPfefferle JKoltsidas IKourtis KGross TChen DDesnoyers Pde Lara E(2017)FlashNetProceedings of the 10th ACM International Systems and Storage Conference10.1145/3078468.3078477(1-14)Online publication date: 22-May-2017
https://dl.acm.org/doi/10.1145/3078468.3078477
Bhaskaran MXu JSwanson S(2014)BankshotACM SIGOPS Operating Systems Review10.1145/2626401.262641748:1(73-81)Online publication date: 15-May-2014
https://dl.acm.org/doi/10.1145/2626401.2626417
Bhaskaran MXu JSwanson SEl Maghraoui KKandiraju G(2013)BankshotProceedings of the 1st Workshop on Interactions of NVM/FLASH with Operating Systems and Workloads10.1145/2527792.2527793(1-9)Online publication date: 3-Nov-2013
https://dl.acm.org/doi/10.1145/2527792.2527793
Tian YYu WVetter J(2012)RXIOComputers and Electrical Engineering10.1016/j.compeleceng.2011.11.00838:3(772-784)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1016/j.compeleceng.2011.11.008
Scott DSharp RGazagnaire TMadhavapeddy A(2010)Using functional programming within an industrial product groupACM SIGPLAN Notices10.1145/1932681.186355745:9(87-92)Online publication date: 27-Sep-2010
https://dl.acm.org/doi/10.1145/1932681.1863557
Scott DSharp RGazagnaire TMadhavapeddy AHudak PWeirich S(2010)Using functional programming within an industrial product groupProceedings of the 15th ACM SIGPLAN international conference on Functional programming10.1145/1863543.1863557(87-92)Online publication date: 27-Sep-2010
https://dl.acm.org/doi/10.1145/1863543.1863557
Traeger AZadok EJoukov NWright C(2008)A nine year study of file system and storage benchmarkingACM Transactions on Storage10.1145/1367829.13678314:2(1-56)Online publication date: 28-May-2008
https://dl.acm.org/doi/10.1145/1367829.1367831
Yu WNoronha RLiang SPanda D(2006)Benefits of high speed interconnects to cluster file systemsProceedings of the 20th international conference on Parallel and distributed processing10.5555/1898699.1898791(273-273)Online publication date: 25-Apr-2006
https://dl.acm.org/doi/10.5555/1898699.1898791
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents