More Web Proxy on the site http://driver.im/

Article

Free access

Measurements of a distributed file system

Authors:

John H. Hartman,

Michael D. Kupfer,

Ken W. Shirriff,

John K. OusterhoutAuthors Info & Claims

SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

Pages 198 - 212

https://doi.org/10.1145/121132.121164

Published: 01 September 1991 Publication History

Abstract

We analyzed the user-level file access patterns and caching behavior of the Sprite distributed file system. The first part of our analysis repeated a study done in 1985 of the: BSD UNIX file system. We found that file throughput has increased by a factor of 20 to an average of 8 Kbytes per second per active user over 10-minute intervals, and that the use of process migration for load sharing increased burst rates by another factor of six. Also, many more very large (multi-megabyte) files are in use today than in 1985. The second part of our analysis measured the behavior of Sprite's main-memory file caches. Client-level caches average about 7 Mbytes in size (about one-quarter to one-third of main memory) and filter out about 50% of the traffic between clients and servers. 35% of the remaining server traffic is caused by paging, even on workstations with large memories. We found that client cache consistency is needed to prevent stale data errors, but that it is not invoked often enough to degrade overall system performance.

References

[1]

Cheriton, D. R., "The V Kernel: A Software Base for Distributed Systems", IEEE Software 1, 2 (April 1984), 19-43.

Digital Library

[2]

Douglis, F. and Ousterhout, J., "Transparent Process Migration: Design Alternatives and the Sprite Implementation", Software---Practice & Experience 21, 7 (July 1991).

Digital Library

[3]

Hisgen, A., Birrell, A., Mann, T., Schroeder, M. and Swart, G., "Availability and Consistency Tradeoffs in the Echo Distributed File System", Proceedings of the Second Workshop on Workstation Operating Systems, September 1989, 49-53.

[4]

Howard, J. H., Kazar, M. L., Menees, S. G., Nichols, D. A., Satyanarayanan, M., Sidebotham, R. N. and West, M. J., "Scale and Performance in a Distributed File System", ACM Transactions on Computer Systems 6, 1 (February 1988), 51-81.

Digital Library

[5]

Kazar, M. L., Leverett, B. W., Anderson, O. T., Apostolides, V., Bottos, B. A., Chutani, S., Everhart, C. F., Mason, W. A., Tu, S. and Zayas, E. R., "DEcorum File System Architectural Overview" Proceedings of the Summer 1990 USENIX Conference, Anaheim, CA, June 11-15 1990, 151- 164.

[6]

Mann, T., Hisgen, A. and Swart, G., An Algorithm for Data Replication, Digital Systems Research Center Tech. Rep. 46, June 1989.

[7]

Mullender, S., van Rossum, G., Tanenbaum, A., van Renesse, R. and van Staveren, H., "Amoeba: A Distributed Operating System for the 1990s", IEEE Computer 23, 5 (May 1990), 44-53.

Digital Library

[8]

Nelson, M. N. and Duffy, J. A., Feasibility of Network Paging and a Page Server Design, Term project, CS 262, Department of EECS, University of California, Berkeley, May 1984.

[9]

Nelson, M. N., Welch, B. B. and Ousterhout, J. K., "Caching in the Sprite Network File System", ACM Transactions on Computer Systems 6, 1 (February 1988), 134-154.

Digital Library

[10]

Nelson, M. N., Physical Memory Management in a Network Operating System, PhD Thesis, University of California, Berkeley, November 1988. Also available as Technical Report UCB/CSD 88/471.

Digital Library

[11]

Ousterhout, J. K., Da Costa, H., Harrison, D., Kunze, J. A., Kupfer, M. and Thompson, J. G., "A Trace- Driven Analysis of the UNIX 4.2 BSD File System", Proceedings of the l Oth Symposium on Operating System Principles, Orcas Island, WA, December 1985, 15-24.

Digital Library

[12]

Ousterhout, j., Cherenson, A., Douglis, F., Nelson, M. and Welch, B., "The Sprite Network Operating System", IEEE Computer 21, 2 (Febm~ 1988), 23-36.

Digital Library

[13]

Ousterhout, J., "Why Aren't Operating Systems Getting Faster As Fast As Hardware?", Proceedings of the Summer 1990 USENIX Conference, Anaheim, CA, June I 1-15 1990, 247-256.

[14]

G.J. Popek and B. J. Walker, eds., The LOCUS Distributed System Architecture, MIT Press, Cambridge, MA, 1985.

Digital Library

[15]

Rosenblum, M. and Ousterhout, J. K., "The Design and implementation of a Log-Structured File System", Proceedings of the 13th Symposium on Operating System Principles, Asilomar, CA, October 1991.

Digital Library

[16]

Sandberg, R., Goldberg, D., Kleiman, S., Walsh, D. and Lyon, B., "Design and Implementation of the Sun Network Filesystem", Proceedings of the Summer 1985 USEN1X Conference, Portland, OR, June 1985, 119-130.

[17]

Welch, B. B., Naming, State Management, and User-Level Extensions in the Sprite Distributed File System, PhD Thesis, University of California, Berkeley, February 1990. Also available as Technical Report UCB/CSD 90/567.

Digital Library

Cited By

Zhang YLi HLiu SHuang P(2023)Hybrid Block Storage for Efficient Cloud Volume ServiceACM Transactions on Storage10.1145/359644619:4(1-25)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1145/3596446
Asyabi EWang YLiagouris JKalavri VBestavros ABromberg YKermarrec AKozyrakis C(2022)A new benchmark harness for systematic and robust evaluation of streaming state storesProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3519592(559-574)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3519592
Dinneen JNguyen B(2021)How Big Are Peoples' Computer Files? File Size Distributions Among User‐managed CollectionsProceedings of the Association for Information Science and Technology10.1002/pra2.47258:1(425-429)Online publication date: 13-Oct-2021
https://dl.acm.org/doi/10.1002/pra2.472
Show More Cited By

Index Terms

Measurements of a distributed file system

Recommendations

Measurements of a distributed file system

We analyzed the user-level file access patterns and caching behavior of the Sprite distributed file system. The first part of our analysis repeated a study done in 1985 of the: BSD UNIX file system. We found that file throughput has increased by a ...
Multilevel caching in distributed file systems
Analysis of caching algorithms for distributed file systems

When picking a cache replacement policy for file systems, LRU (Least Recently Used) has always been the obvious choice, because of the temporal locality found in programs and data. However, in the case of Sun NFS servers much of the locality is filtered ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

September 1991

253 pages

ISBN:0897914473

DOI:10.1145/121132

Chairman:
Henry M. Levy
Univ. of Washington, Seattle

ACM SIGOPS Operating Systems Review Volume 25, Issue 5
Oct. 1991
253 pages
ISSN:0163-5980
DOI:10.1145/121133
Editor:
Henry M. Levy
Univ. of Washington, Seattle
Issue’s Table of Contents

Copyright © 1991 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1991

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SOSP91

Sponsor:

SIGOPS

SOSP91: 13th ACM Symposium on Operating Systems Principles

October 13 - 16, 1991

California, Pacific Grove, USA

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

359
Total Citations
View Citations
3,095
Total Downloads

Downloads (Last 12 months)245
Downloads (Last 6 weeks)40

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YLi HLiu SHuang P(2023)Hybrid Block Storage for Efficient Cloud Volume ServiceACM Transactions on Storage10.1145/359644619:4(1-25)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1145/3596446
Asyabi EWang YLiagouris JKalavri VBestavros ABromberg YKermarrec AKozyrakis C(2022)A new benchmark harness for systematic and robust evaluation of streaming state storesProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3519592(559-574)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3519592
Dinneen JNguyen B(2021)How Big Are Peoples' Computer Files? File Size Distributions Among User‐managed CollectionsProceedings of the Association for Information Science and Technology10.1002/pra2.47258:1(425-429)Online publication date: 13-Oct-2021
https://dl.acm.org/doi/10.1002/pra2.472
Yang JYue YRashmi KLu SHowell J(2020)A large scale analysis of hundreds of in-memory cache clusters at TwitterProceedings of the 14th USENIX Conference on Operating Systems Design and Implementation10.5555/3488766.3488777(191-208)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.5555/3488766.3488777
Rong YWu WChen Z(2019)COMBFTProceedings of the 48th International Conference on Parallel Processing10.1145/3337821.3337885(1-10)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3337821.3337885
Li HZhang YLi DZhang ZLiu SHuang PQin ZChen KXiong Y(2019)URSAProceedings of the Fourteenth EuroSys Conference 201910.1145/3302424.3303967(1-17)Online publication date: 25-Mar-2019
https://dl.acm.org/doi/10.1145/3302424.3303967
Al Assaf MJiang XQin XAbid MQiu MZhang J(2018)Informed Prefetching for Distributed Multi-Level Storage SystemsJournal of Signal Processing Systems10.1007/s11265-017-1277-z90:4(619-640)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1007/s11265-017-1277-z
Yang JKarimi RSæmundsson TWildani AVigfusson Y(2017)MithrilProceedings of the 2017 Symposium on Cloud Computing10.1145/3127479.3131210(66-79)Online publication date: 24-Sep-2017
https://dl.acm.org/doi/10.1145/3127479.3131210
Najafzadeh MShapiro MEugster P(2017)Co-Design and Verification of an Available File SystemVerification, Model Checking, and Abstract Interpretation10.1007/978-3-319-73721-8_17(358-381)Online publication date: 29-Dec-2017
https://doi.org/10.1007/978-3-319-73721-8_17
Simitci HReed D(2016)A Comparison of Logical and Physical Parallel I/o pAtternsThe International Journal of High Performance Computing Applications10.1177/10943420980120030512:3(364-380)Online publication date: 26-Jul-2016
https://doi.org/10.1177/109434209801200305
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents