More Web Proxy on the site http://driver.im/

Article

Free access

Replication in the harp file system

Authors:

Barbara Liskov,

Sanjay Ghemawat,

Michael WilliamsAuthors Info & Claims

SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

Pages 226 - 238

https://doi.org/10.1145/121132.121169

Published: 01 September 1991 Publication History

Abstract

This paper describes the design and implementation of the Harp file system. Harp is a replicated Unix file system accessible via the VFS interface. It provides highly available and reliable storage for files and guarantees that file operations are executed atomically in spite of concurrency and failures. It uses a novel variation of the primary copy replication technique that provides good performance because it allows us to trade disk accesses for network communication. Harp is intended to be used within a file service in a distributed network; in our current implementation, it is accessed via NFS. Preliminary performance results indicate that Harp provides equal or better response time and system capacity than an unreplicated implementation of NFS that uses Unix files directly.

References

[1]

Alsberg, P., and Day, J. A Principle for Resilient Sharing of Distributed Resources. Proc. of the 2nd Intemational Conference on Software Engineering, October, 1976, pp. 627-644. Also available in unpublished form as CAC Document number 202 Center for Advanced Computation University of Illinois, Urbana-Champaign, Illinois 61801 by Alsberg, Benford, Day, and Grapa.]]

Digital Library

[2]

Bartlett, J. A 'NonStop' Operating System. Proc. of the Eleventh Hawaii International Conference on System Sciences, January, 1978, pp. 103- 117.]]

[3]

Bartlett, J. A NonStop Kernel. Proc. of the 8th ACM Symposium on Operating System Principles, December, 1981, pp. 22-29.]]

Digital Library

[4]

Bemstein, P. A., Hadzilacos, V., and Goodman, N. Concurrency Control and Recovery in Database Systems. Addison Wesley, 1987.]]

Digital Library

[5]

Bhide, A., Elnozahy, E., and Morgan, S. Implicit Replication in a Network File Server. Proc. of the Workshop on Management of Replicated Data, IEEE, Houston, TX, November, 1990.]]

[6]

Birman, K., and loseph, T. Exploiting Virtual Synchrony in Distributed Systems. Proc. of the Eleventh ACM Symposium on Operating Systems Principles, November, 1987, pp. 123-138.]]

Digital Library

[7]

Daniels, D. S., Spector, A. Z., and Thompson, D. S. Distributed Logging for Transaction Processing. ACM Special Interest Group on Management of Data 1987 Annual Conference, ACM SIGMOD, San Francisco, CA, May, 1987, pp. 82-96.]]

Digital Library

[8]

Deering S. E., and Cheriton D.R. "Multicast Routing in Datagram Intemetworks and Extended LANs". ACM Trans. on Computer Systems 8, 2 (May 1990).]]

Digital Library

[9]

EI-Abbadi, A., and Toueg, S. Maintaining Availability in Partitioned Replicated Databases. Proc. of the Fifth Symposium on Principles of Database Systems, ACM, 1986, pp. 240-251.]]

Digital Library

[10]

Ei-Abbadi, A., Skeen, D., and Cristian, F. An Efficient Fault-tolerant Protocol for Replicated Data Management. Proc. of the Fourth Symposium on Principles of Database Systems, ACM, 1985, pp. 215-229.]]

Digital Library

[11]

Ghemawat, S. Automatic Replication for Highly Available Services. Technical Report MIT/LCS/TR-473, MIT Laboratory for Computer Science, Cambridge, MA, 1990.]]

Digital Library

[12]

Gifford, D. K. Weighted Voting for Replicated Data. Pro<:. of the Seventh Symposium on Operating Systems Principles, ACM SIGOPS, Pacific Grove, CA, December, 1979, pp. 150-162.]]

Digital Library

[13]

Gifford, D.K. Information Storage in a Decentralized Computer System. Technical Report CSL-81-8, Xerox Corporation, March, 1983.]]

[14]

Guy, R., Heidemann, J., Mak, W., Page, T., Jr., Popek, G., and Rothneier, D. Implementation of the Ficus Replicated File System. USENIX Conference Proceedings, June, 1990, pp. 63-71.]]

[15]

Hagmann, R. Reimplemenfing the Cedar File System Using Logging and Group Commit. Proc. of the Eleventh Symposium on Operating Systems Principles, November, 1987, pp. 155-162.]]

Digital Library

[16]

Hisgen, A., Birrell, A., jerian, C., Mann, T., Schroeder, M., and Swart, G. Granularity and Semantic Level of Replication in the Echo Distributed File System. Proc. of the Workshop on Management of Replicated Data, IEEE, Houston, TX, November, 1990.]]

[17]

Howard, J., Kazar, M., Menees, S., Nichols, D., Satyanarayanan, M., Sidebotham, R., and West, M. "Scale and Performance in a Distributed File System". ACM Trans. on Computer Systems 6, 1 (February 1988).]]

Digital Library

[18]

Kazar, M., Leverett, B., Anderson, O., Apostolides, V., Bottos, B., Chutani, S., Everhart, C., Mason, W., Tu, S., and Zayas, E. Decorum File System Architectural Overview. USENIX Summer '90 Conference Proceedings, 1990, pp. 151-163.]]

[19]

Kleiman, S. Vnodes: An Architecture for Multiple File System Types in Sun UNIX. USENIX Summer '86 Conference Proceedings, 1986, pp. 238-247.]]

[20]

Lampson, B. W., and Sturgis, H.E. Crash Recovery in a Distributed Data Storage System. Xerox Research Center, Palo Alto, CA, 1979.]]

[21]

Mann, T., Hisgen, A., and Swart, G. An Algorithm for Data Replication. Report 46, DEC Systems Research Center, Palo Alto, CA, June, 1989.]]

[22]

Marzullo, K., and Schmuck, F. Supplying High Availability with a Standard Network File System. Proc. of the 8th International Conference on Distributed Computing Systems, IEEE, June, 1988, pp. 447-453.]]

[23]

Mills, D.L. Network Time Protocol (Version 1) Specification and Implementation. DARPA-Intemet Report RFC 1059. July, 1988,]]

Digital Library

[24]

Nelson, M., Welch, B., and Ousterhout, J. "Caching in the Sprite Network File System". ACM Trans. on Computer Systems 6, 1 (February 1988), 134-154.]]

Digital Library

[25]

Legato Systems Inc. NFSSTONE NFS Load Generating Program. Palo Alto, CA.]]

[26]

Oki, B. M., and Liskov, B. Viewstamped Replication: A New Primary Copy Method to Support Highly-Available Distributed Systems. Proc. of the 7th ACM Symposium on Principles of Distributed Computing, ACM, August, 1988.]]

Digital Library

[27]

Oki, B. M. Viewstamped Replication for Highly Available Distributed Systems. Technical Report MIT/LCSflR-423, MIT Laboratory for Computer Science, Cambridge, MA, 1988.]]

Digital Library

[28]

Pads, J-F. Voting With Wimesses: A Consistency Scheme for Replicated Files. Proc. of the 6th International Conference on Distributed Computer Systems, IEEE, 1986, pp. 606-612.]]

[29]

Rodriguez, R., Koehler, M., and Hyde, R. The Genetic File System. USENIX Summer '86 Conference Proceedings, 1986, pp. 260-269.]]

[30]

Rosenblum, M., and Ousterhout, J. The Design and implementation of a Log-Structured File System. To be published in the Proc. of the Thirteenth ACM Symposium on Operating Systems Principles, October 1991.]]

Digital Library

[31]

Sandberg, R., et al. Design and Implementation of the Sun Network Filesystem. Proc. of the Summer 1985 USENIX Conference, June, 1985, pp. 119-130.]]

[32]

Satyanarayanan, M., et al. Coda: A Highly Available File System for a Distributed Workstation Environment. Tech. Rept. CMU-CS-89-165, Carnegie Mellon University, School of Computer Science, Pittsburgh, PA, July, 1989.]]

[33]

Schneider, F. B. Fail-Stop Processors. Digest of Papers from Spring CompCon '83 26th IEEE Computer Society International Conference, IEEE, March, 1983, pp. 66-70.]]

[34]

Shein, B., et al. NFSSTONE- A Network File Server Performance Benchmark. USENIX Summer '89 Conference Proceedings, 1989, pp. 269-274.]]

[35]

Sun Microsystems, Inc. NFS: Network File System Protocol Specification. Tech. Rept. RFC 1094, Network Information Center, SRI International, March, 1989.]]

Digital Library

[36]

Sun Microsystems, Inc. RPC: Remote Procedure Call Protocol Specification, Version 2. DARPA-Intemet RFC 1057. June, 1988.]]

Digital Library

[37]

Walker, B., Popek, G., English, R., Kline, C., Thiel, G. The LOCUS Distributed Operating System. Proc. of the 9th Symposium on Operating Systems Principles, ACM, Bretton Woods, NH, October, 1983.]]

Digital Library

Cited By

Xu YZhu HPandey PConway AJohnson RGanesan AAlagappan RMa XWon Y(2024)IONIAProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650711(225-242)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650711
Tomita A(2022)A Framework to Manage a Penetration of Digital Systems into Physical Society2022 Portland International Conference on Management of Engineering and Technology (PICMET)10.23919/PICMET53225.2022.9882756(1-7)Online publication date: Aug-2022
https://doi.org/10.23919/PICMET53225.2022.9882756
Ganesan AAlagappan RRebello AArpaci-Dusseau AArpaci-Dusseau R(2022)Exploiting Nil-external Interfaces for Fast Replicated StorageACM Transactions on Storage10.1145/354282118:3(1-35)Online publication date: 2-Sep-2022
https://dl.acm.org/doi/10.1145/3542821
Show More Cited By

Index Terms

Replication in the harp file system
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
    2. Extra-functional properties
      1. Software fault tolerance
        Checkpoint / restart

Recommendations

Replication in the harp file system

This paper describes the design and implementation of the Harp file system. Harp is a replicated Unix file system accessible via the VFS interface. It provides highly available and reliable storage for files and guarantees that file operations are ...
File Migration and File Replication: A Symbiotic Relationship

Much of the past research on file migration and file replication has examined these two resource management strategies in isolation or in an environment where they do not work together. We establish through simulation that these two strategies can be ...
Replication, history, and grafting in the Ori file system
SOSP '13: Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

Ori is a file system that manages user data in a modern setting where users have multiple devices and wish to access files everywhere, synchronize data, recover from disk failure, access old versions, and share data. The key to satisfying these needs is ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

September 1991

253 pages

ISBN:0897914473

DOI:10.1145/121132

Chairman:
Henry M. Levy
Univ. of Washington, Seattle

ACM SIGOPS Operating Systems Review Volume 25, Issue 5
Oct. 1991
253 pages
ISSN:0163-5980
DOI:10.1145/121133
Editor:
Henry M. Levy
Univ. of Washington, Seattle
Issue’s Table of Contents

Copyright © 1991 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1991

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SOSP91

Sponsor:

SIGOPS

SOSP91: 13th ACM Symposium on Operating Systems Principles

October 13 - 16, 1991

California, Pacific Grove, USA

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

168
Total Citations
View Citations
2,179
Total Downloads

Downloads (Last 12 months)147
Downloads (Last 6 weeks)24

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu YZhu HPandey PConway AJohnson RGanesan AAlagappan RMa XWon Y(2024)IONIAProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650711(225-242)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650711
Tomita A(2022)A Framework to Manage a Penetration of Digital Systems into Physical Society2022 Portland International Conference on Management of Engineering and Technology (PICMET)10.23919/PICMET53225.2022.9882756(1-7)Online publication date: Aug-2022
https://doi.org/10.23919/PICMET53225.2022.9882756
Ganesan AAlagappan RRebello AArpaci-Dusseau AArpaci-Dusseau R(2022)Exploiting Nil-external Interfaces for Fast Replicated StorageACM Transactions on Storage10.1145/354282118:3(1-35)Online publication date: 2-Sep-2022
https://dl.acm.org/doi/10.1145/3542821
Ganesan AAlagappan RArpaci-Dusseau AArpaci-Dusseau R(2021)Exploiting Nil-Externality for Fast Replicated StorageProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483543(440-456)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483543
Ma FFan R(2021)Markov Processes in Data Center NetworksIEEE Access10.1109/ACCESS.2021.30657629(42216-42225)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3065762
Zhu HBai ZLi JMichael EPorts DStoica IJin X(2019)HarmoniaProceedings of the VLDB Endowment10.14778/3368289.336830113:3(376-389)Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.14778/3368289.3368301
Sánchez CSchneider GAhrendt WBartocci EBianculli DColombo CFalcone YFrancalanza AKrstić SLourenço JNickovic DPace GRufino JSignoles JTraytel DWeiss A(2019)A survey of challenges for runtime verification from advanced application domains (beyond software)Formal Methods in System Design10.1007/s10703-019-00337-w54:3(279-335)Online publication date: 11-Nov-2019
https://doi.org/10.1007/s10703-019-00337-w
Harizopoulos SAbadi DMadden SStonebraker M(2018)OLTP through the looking glass, and what we found thereMaking Databases Work10.1145/3226595.3226635(409-439)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1145/3226595.3226635
Ashouri ABignoli APalermo GSilvano CKulkarni SCavazos J(2017)MiCOMPACM Transactions on Architecture and Code Optimization10.1145/312445214:3(1-28)Online publication date: 6-Sep-2017
https://dl.acm.org/doi/10.1145/3124452
Yang J(2017)Elastic Load Balancing Using Self-Adaptive Replication ManagementIEEE Access10.1109/ACCESS.2016.26314905(7495-7504)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2016.2631490
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents