article

The Google file system

Authors:

Sanjay Ghemawat,

Howard Gobioff,

Shun-Tak LeungAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 37, Issue 5

Pages 29 - 43

https://doi.org/10.1145/1165389.945450

Published: 19 October 2003 Publication History

Get Access

References

[1]

Thomas Anderson, Michael Dahlin, Jeanna Neefe, David Patterson, Drew Roselli, and Randolph Wang. Serverless network file systems. In Proceedings of the 15th ACM Symposium on Operating System Principles, pages 109--126, Copper Mountain Resort, Colorado, December 1995.

Digital Library

Google Scholar

[2]

Remzi H. Arpaci-Dusseau, Eric Anderson, Noah Treuhaft, David E. Culler, Joseph M. Hellerstein, David Patterson, and Kathy Yelick. Cluster I/O with River: Making the fast case common. In Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS '99), pages 10--22, Atlanta, Georgia, May 1999.

Digital Library

Google Scholar

[3]

Luis-Felipe Cabrera and Darrell D. E. Long. Swift: Using distributed disk striping to provide high I/O data rates. Computer Systems, 4(4):405--436, 1991.

Google Scholar

[4]

Garth A. Gibson, David F. Nagle, Khalil Amiri, Jeff Butler, Fay W. Chang, Howard Gobioff, Charles Hardin, Erik Riedel, David Rochberg, and Jim Zelenka. A cost-effective, high-bandwidth storage architecture. In Proceedings of the 8th Architectural Support for Programming Languages and Operating Systems, pages 92--103, San Jose, California, October 1998.

Digital Library

Google Scholar

[5]

John Howard, Michael Kazar, Sherri Menees, David Nichols, Mahadev Satyanarayanan, Robert Sidebotham, and Michael West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51--81, February 1988.

Digital Library

Google Scholar

[6]

InterMezzo. http://www.inter-mezzo.org, 2003.

Google Scholar

[7]

Barbara Liskov, Sanjay Ghemawat, Robert Gruber, Paul Johnson, Liuba Shrira, and Michael Williams. Replication in the Harp file system. In 13th Symposium on Operating System Principles, pages 226--238, Pacific Grove, CA, October 1991.

Digital Library

Google Scholar

[8]

Lustre. http://www.lustreorg, 2003.

Google Scholar

[9]

David A. Patterson, Garth A. Gibson, and Randy H. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data, pages 109--116, Chicago, Illinois, September 1988.

Digital Library

Google Scholar

[10]

Frank Schmuck and Roger Haskin. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the First USENIX Conference on File and Storage Technologies, pages 231--244, Monterey, California, January 2002.

Digital Library

Google Scholar

[11]

Steven R. Soltis, Thomas M. Ruwart, and Matthew T. O'Keefe. The Gobal File System. In Proceedings of the Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, College Park, Maryland, September 1996.

Google Scholar

[12]

Chandramohan A. Thekkath, Timothy Mann, and Edward K. Lee. Frangipani: A scalable distributed file system. In Proceedings of the 16th ACM Symposium on Operating System Principles, pages 224--237, Saint-Malo, France, October 1997.

Digital Library

Google Scholar

Cited By

View all

Gong ZWu SXu Y(2024)Hybrid fault tolerance in distributed in-memory storage systemsJUSTC10.52396/JUSTC-2022-012554:4(0406)Online publication date: 2024
https://doi.org/10.52396/JUSTC-2022-0125
Gupta MGupta ARaj S. BSharma A(2024)JWTAMH: JSON Web Tokens Based Authentication Mechanism for HADOOP.ICST Transactions on Scalable Information Systems10.4108/eetsis.542911Online publication date: 17-Jul-2024
https://doi.org/10.4108/eetsis.5429
Santos W(2024)Fractional decoding and the Rosenbloom-Tsfasman metricAdvances in Mathematics of Communications10.3934/amc.2023061(0-0)Online publication date: 2024
https://doi.org/10.3934/amc.2023061
Show More Cited By

Index Terms

The Google file system
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Memory management
        Distributed memory
    2. Software system structures
      1. Distributed systems organizing principles

Recommendations

The Google file system
SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles
WORMStore: A Specialized Object Store for Write-Once Read-Many Workloads
MASCOTS '14: Proceedings of the 2014 IEEE 22nd International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems

The recent increase in interest for batch analytics has resulted in extensive use of distributed frameworks such as Hadoop and Dryad. Batch analytics-as the name suggests, perform many computations on large volumes of data. That is, large quantities of ...
A Novel Solution of Distributed File Storage for Cloud Service
COMPSACW '12: Proceedings of the 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops

With the rapid development of the Internet application technology, especially Web2.0 and cloud computing, the data content people produced on the network grew in the geometric progression. And one of the fastest growing and the most likely to challenge ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 37, Issue 5

SOSP '03

December 2003

329 pages

ISSN:0163-5980

DOI:10.1145/1165389

Issue’s Table of Contents

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles
October 2003
338 pages
ISBN:1581137575
DOI:10.1145/945445
General Chair:
Michael L. Scott
University of Rochester
,
Program Chair:
Larry Peterson
Princeton University

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2003

Published in SIGOPS Volume 37, Issue 5

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3,411
Total Citations
View Citations
67,418
Total Downloads

Downloads (Last 12 months)3,934
Downloads (Last 6 weeks)900

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gong ZWu SXu Y(2024)Hybrid fault tolerance in distributed in-memory storage systemsJUSTC10.52396/JUSTC-2022-012554:4(0406)Online publication date: 2024
https://doi.org/10.52396/JUSTC-2022-0125
Gupta MGupta ARaj S. BSharma A(2024)JWTAMH: JSON Web Tokens Based Authentication Mechanism for HADOOP.ICST Transactions on Scalable Information Systems10.4108/eetsis.542911Online publication date: 17-Jul-2024
https://doi.org/10.4108/eetsis.5429
Santos W(2024)Fractional decoding and the Rosenbloom-Tsfasman metricAdvances in Mathematics of Communications10.3934/amc.2023061(0-0)Online publication date: 2024
https://doi.org/10.3934/amc.2023061
Ashwini Shivarudra (2024)Optimizing Test Data Management Strategies in Banking Domain ProjectsJournal of Sustainable Solutions10.36676/j.sust.sol.v1.i4.371:4(87-100)Online publication date: 28-Oct-2024
https://doi.org/10.36676/j.sust.sol.v1.i4.37
Yue ZZheng XZhang SZhong LZhang W(2024)Influencing Path of Consumer Digital Hoarding Behavior on E-Commerce PlatformsSustainability10.3390/su16231034116:23(10341)Online publication date: 26-Nov-2024
https://doi.org/10.3390/su162310341
Farkaš P(2024)Scalable codes with locality and availability derived from tessellation via [7, 3, 4] Simplex code graphJournal of Electrical Engineering10.2478/jee-2024-002375:3(192-197)Online publication date: 8-Jun-2024
https://doi.org/10.2478/jee-2024-0023
Li B(2024)GreatFree as a Generic Distributed Programming Language and the Foundation of the Cloud-Side Operating SystemInternational Journal of Advanced Network, Monitoring and Controls10.2478/ijanmc-2023-00788:4(66-81)Online publication date: 16-Mar-2024
https://doi.org/10.2478/ijanmc-2023-0078
Tomita A(2024)Open Technology Management for Maximizing the Public Value of Large Language Models2024 Portland International Conference on Management of Engineering and Technology (PICMET)10.23919/PICMET64035.2024.10652994(1-11)Online publication date: 4-Aug-2024
https://doi.org/10.23919/PICMET64035.2024.10652994
Udayashankar SBaba AAl-Kiswany SSchiavoni VEdinger JCao JJin Z(2024)SeqCDC: Hashless Content-Defined Chunking for Data DeduplicationProceedings of the 25th International Middleware Conference10.1145/3652892.3700766(292-298)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3652892.3700766
Shapson-Coe AJanuszewski MBerger DPope AWu YBlakely TSchalek RLi PWang SMaitin-Shepard JKarlupia NDorkenwald SSjostedt ELeavitt LLee DTroidl JCollman FBailey LFitzmaurice AKar RField BWu HWagner-Carena JAley DLau JLin ZWei DPfister HPeleg AJain VLichtman J(2024)A petavoxel fragment of human cerebral cortex reconstructed at nanoscale resolutionScience10.1126/science.adk4858384:6696Online publication date: 10-May-2024
https://doi.org/10.1126/science.adk4858
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The Google file system

WORMStore: A Specialized Object Store for Write-Once Read-Many Workloads

A Novel Solution of Distributed File Storage for Cloud Service