Article

The Google file system

Authors:

Sanjay Ghemawat,

Howard Gobioff,

Shun-Tak LeungAuthors Info & Claims

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles

Pages 29 - 43

https://doi.org/10.1145/945445.945450

Published: 19 October 2003 Publication History

Get Access

References

[1]

Thomas Anderson, Michael Dahlin, Jeanna Neefe, David Patterson, Drew Roselli, and Randolph Wang. Serverless network file systems. In Proceedings of the 15th ACM Symposium on Operating System Principles, pages 109--126, Copper Mountain Resort, Colorado, December 1995.

Digital Library

Google Scholar

[2]

Remzi H. Arpaci-Dusseau, Eric Anderson, Noah Treuhaft, David E. Culler, Joseph M. Hellerstein, David Patterson, and Kathy Yelick. Cluster I/O with River: Making the fast case common. In Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS '99), pages 10--22, Atlanta, Georgia, May 1999.

Digital Library

Google Scholar

[3]

Luis-Felipe Cabrera and Darrell D. E. Long. Swift: Using distributed disk striping to provide high I/O data rates. Computer Systems, 4(4):405--436, 1991.

Google Scholar

[4]

Garth A. Gibson, David F. Nagle, Khalil Amiri, Jeff Butler, Fay W. Chang, Howard Gobioff, Charles Hardin, Erik Riedel, David Rochberg, and Jim Zelenka. A cost-effective, high-bandwidth storage architecture. In Proceedings of the 8th Architectural Support for Programming Languages and Operating Systems, pages 92--103, San Jose, California, October 1998.

Digital Library

Google Scholar

[5]

John Howard, Michael Kazar, Sherri Menees, David Nichols, Mahadev Satyanarayanan, Robert Sidebotham, and Michael West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51--81, February 1988.

Digital Library

Google Scholar

[6]

InterMezzo. http://www.inter-mezzo.org, 2003.

Google Scholar

[7]

Barbara Liskov, Sanjay Ghemawat, Robert Gruber, Paul Johnson, Liuba Shrira, and Michael Williams. Replication in the Harp file system. In 13th Symposium on Operating System Principles, pages 226--238, Pacific Grove, CA, October 1991.

Digital Library

Google Scholar

[8]

Lustre. http://www.lustreorg, 2003.

Google Scholar

[9]

David A. Patterson, Garth A. Gibson, and Randy H. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data, pages 109--116, Chicago, Illinois, September 1988.

Digital Library

Google Scholar

[10]

Frank Schmuck and Roger Haskin. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the First USENIX Conference on File and Storage Technologies, pages 231--244, Monterey, California, January 2002.

Digital Library

Google Scholar

[11]

Steven R. Soltis, Thomas M. Ruwart, and Matthew T. O'Keefe. The Gobal File System. In Proceedings of the Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, College Park, Maryland, September 1996.

Google Scholar

[12]

Chandramohan A. Thekkath, Timothy Mann, and Edward K. Lee. Frangipani: A scalable distributed file system. In Proceedings of the 16th ACM Symposium on Operating System Principles, pages 224--237, Saint-Malo, France, October 1997.

Digital Library

Google Scholar

Cited By

View all

Fu XPan LLiu S(2025)Caching or re-computing: Online cost optimization for running big data tasks in IaaS cloudsJournal of Network and Computer Applications10.1016/j.jnca.2024.104080235(104080)Online publication date: Mar-2025
https://doi.org/10.1016/j.jnca.2024.104080
Ren YRen YLi XHu YLi JLee PMa XWon Y(2024)ELECTProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650715(293-310)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650715
Zhang WXu EWang QZhang XGu YLu ZOuyang TDai GPeng WXu ZZhang SWu DPeng YWang TZhang HWang JYan WDong YYao WWu ZZhu LShi CWang YLiu RWu JZhu JWu JMa XWon Y(2024)What's the story in EBS gloryProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650714(277-292)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650714
Show More Cited By

Index Terms

The Google file system
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Memory management
        Distributed memory
    2. Software system structures
      1. Distributed systems organizing principles

Recommendations

The Google file system
SOSP '03
A Novel Solution of Distributed File Storage for Cloud Service
COMPSACW '12: Proceedings of the 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops

With the rapid development of the Internet application technology, especially Web2.0 and cloud computing, the data content people produced on the network grew in the geometric progression. And one of the fastest growing and the most likely to challenge ...
WORMStore: A Specialized Object Store for Write-Once Read-Many Workloads
MASCOTS '14: Proceedings of the 2014 IEEE 22nd International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems

The recent increase in interest for batch analytics has resulted in extensive use of distributed frameworks such as Hadoop and Dryad. Batch analytics-as the name suggests, perform many computations on large volumes of data. That is, large quantities of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles

October 2003

338 pages

ISBN:1581137575

DOI:10.1145/945445

General Chair:
Michael L. Scott
University of Rochester
,
Program Chair:
Larry Peterson
Princeton University

ACM SIGOPS Operating Systems Review Volume 37, Issue 5
SOSP '03
December 2003
329 pages
ISSN:0163-5980
DOI:10.1145/1165389
Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SOSP03

Sponsor:

SOSP03: ACM Symposium on Operating Systems Principles

October 19 - 22, 2003

NY, Bolton Landing, USA

Acceptance Rates

SOSP '03 Paper Acceptance Rate 22 of 128 submissions, 17%;

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3,412
Total Citations
View Citations
67,531
Total Downloads

Downloads (Last 12 months)4,047
Downloads (Last 6 weeks)753

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Fu XPan LLiu S(2025)Caching or re-computing: Online cost optimization for running big data tasks in IaaS cloudsJournal of Network and Computer Applications10.1016/j.jnca.2024.104080235(104080)Online publication date: Mar-2025
https://doi.org/10.1016/j.jnca.2024.104080
Ren YRen YLi XHu YLi JLee PMa XWon Y(2024)ELECTProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650715(293-310)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650715
Zhang WXu EWang QZhang XGu YLu ZOuyang TDai GPeng WXu ZZhang SWu DPeng YWang TZhang HWang JYan WDong YYao WWu ZZhu LShi CWang YLiu RWu JZhu JWu JMa XWon Y(2024)What's the story in EBS gloryProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650714(277-292)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650714
Wenger RMichéa DPuissant A(2024)Towards an annual urban settlement map in France at 10 m spatial resolution using a method for massive streams of Sentinel-2 dataCybergeo10.4000/12vzaOnline publication date: 2024
https://doi.org/10.4000/12vza
Oliveira RPedrosa TRufino JLopes R(2024)Parameterization and Performance Analysis of a Scalable, near Real-Time Packet Capturing PlatformSystems10.3390/systems1204012612:4(126)Online publication date: 7-Apr-2024
https://doi.org/10.3390/systems12040126
Wu ZLv XYun YDuan W(2024)A Parallel Sequential SBAS Processing Framework Based on Hadoop Distributed ComputingRemote Sensing10.3390/rs1603046616:3(466)Online publication date: 25-Jan-2024
https://doi.org/10.3390/rs16030466
Azzabi SAlfughi ZOuda A(2024)Data Lakes: A Survey of Concepts and ArchitecturesComputers10.3390/computers1307018313:7(183)Online publication date: 22-Jul-2024
https://doi.org/10.3390/computers13070183
Zhu JSun WYe THu W(2024)Dynamic capacity sharing with multi-wavelength integrated transmitters in hybrid datacenter networksJournal of Optical Communications and Networking10.1364/JOCN.52844316:10(990)Online publication date: 19-Sep-2024
https://doi.org/10.1364/JOCN.528443
Li YGu RLi SWang BYu W(2024)ColdPurge: Effecient Metadata Cache Cleaning via Accurate Online Data Hotness TrackingProceedings of the 25th International Middleware Conference Industrial Track10.1145/3700824.3701094(8-14)Online publication date: 2-Dec-2024
https://dl.acm.org/doi/10.1145/3700824.3701094
Alves CIdalino TMendizabal O(2024)Extending State Machine Replication through CompositionProceedings of the 13th Latin-American Symposium on Dependable and Secure Computing10.1145/3697090.3697106(231-240)Online publication date: 26-Nov-2024
https://dl.acm.org/doi/10.1145/3697090.3697106
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The Google file system

A Novel Solution of Distributed File Storage for Cloud Service

WORMStore: A Specialized Object Store for Write-Once Read-Many Workloads