More Web Proxy on the site http://driver.im/

research-article

A file is not a file: understanding the I/O behavior of Apple desktop applications

Authors:

Michael Vaughn,

Andrea C. Arpaci-Dusseau,

Remzi H. Arpaci-DusseauAuthors Info & Claims

SOSP '11: Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles

Pages 71 - 83

https://doi.org/10.1145/2043556.2043564

Published: 23 October 2011 Publication History

Abstract

We analyze the I/O behavior of iBench, a new collection of productivity and multimedia application workloads. Our analysis reveals a number of differences between iBench and typical file-system workload studies, including the complex organization of modern files, the lack of pure sequential access, the influence of underlying frameworks on I/O patterns, the widespread use of file synchronization and atomic operations, and the prevalence of threads. Our results have strong ramifications for the design of next generation local and cloud-based storage systems.

References

[1]

N. Agrawal, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Generating Realistic Impressions for File-System Benchmarking. In FAST '09, San Jose, CA, February 2009.

Digital Library

[2]

N. Agrawal, W. J. Bolosky, J. R. Douceur, and J. R. Lorch. A Five-Year Study of File-System Metadata. In FAST '07, San Jose. CA, February 2007.

Digital Library

[3]

Apple Computer, Inc. AppleScript Language Guide, March 2011.

[4]

M. Baker, J. Hartman, M. Kupfer, K. Shirriff, and J. Ousterhout. Measurements of a Distributed File System. In SOSP '91, pages 198--212, Pacific Grove, CA, October 1991.

Digital Library

[5]

W. Bartlett and L. Spainhower. Commercial Fault Tolerance: A Tale of Two Systems. IEEE Transactions on Dependable and Secure Computing, 1(1):87--96, January 2004.

Digital Library

[6]

G. Blake, R. G. Dreslinski, T. Mudge, and K. Flautner. Evolution of Thread-level Parallelism in Desktop Applications. SIGARCH Comput. Archit. News, 38:302--313, June 2010.

Digital Library

[7]

J. Bonwick and B. Moore. ZFS: The Last Word in File Systems. http://opensolaris.org/os/community/zfs/docs/zfs_last.pdf. 2007.

[8]

B. Cantrill, M. W. Shapiro, and A. H. Leventhal. Dynamic Instrumentation of Production Systems. In USENIX '04, pages 15--28, Boston, MA, June 2004.

Digital Library

[9]

G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's Highly Available Key-Value Store. In SOSP '07, Stevenson, WA, October 2007.

Digital Library

[10]

J. R. Douceur and W. J. Bolosky. A Large-Scale Study of File-System Contents. In SIGMETRICS '99, pages 59--69, Atlanta, GA, May 1999.

Digital Library

[11]

D. Ellard and M. I. Seltzer. New NFS Tracing Tools and Techniques for System Analysis. In LISA '03, pages 73--85, San Diego, CA, October 2003.

Digital Library

[12]

Y. Endo, Z. Wang, J. B. Chen, and M. Seltzer. Using Latency to Evaluate Interactive System Performance. In OSDI '96, Seattle, WA, October 1994.

Digital Library

[13]

K. Flautner, R. Uhlig, S. Reinhardt, and T. Mudge. Thread-level Parallelism and Interactive Performance of Desktop Applications. SIGPLAN Not., 35:129--138, November 2000.

Digital Library

[14]

S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google File System. In SOSP '03, pages 29--43, Bolton Landing, NY, October 2003.

Digital Library

[15]

R. Hagmann. Reimplementing the Cedar File System Using Logging and Group Commit. In SOSP '87, Austin, TX, November 1987.

Digital Library

[16]

J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, and M. West. Scale and Performance in a Distributed File System. ACM Transactions on Computer Systems, 6(1), February 1988.

Digital Library

[17]

B. Lampson. Computer Systems Research - Past and Present. SOSP 17 Keynote Lecture, December 1999.

[18]

E. K. Lee and C. A. Thekkath. Petal: Distributed Virtual Disks. In ASPLOS VII, Cambridge, MA, October 1996.

Digital Library

[19]

A. W. Leung, S. Pasupathy, G. R. Goodson, and E. L. Miller. Measurement and Analysis of Large-Scale Network File System Workloads. In USENIX '08, pages 213--226, Boston, MA, June 2008.

Digital Library

[20]

Macintosh Business Unit (Microsoft). It's all in the numbers... blogs.msdn.com/b/macmojo/archive/2006/11/03/it-s-all-in-the-numbers.aspx, November 2006.

[21]

M. K. McKusick, W. N. Joy, S. J. Leffler, and R. S. Fabry. A Fast File System for UNIX. ACM Transactions on Computer Systems, 2(3): 181--197, August 1984.

Digital Library

[22]

J. C. Mogul. A Better Update Policy. In USENIX Summer '94, Boston, MA, June 1994.

Digital Library

[23]

J. Olson. Enhance Your Apps With File System Transactions. http://msdn.microsoft.com/en-us/magazine/cc163388.aspx, July 2007.

[24]

J. Ousterhout. Why Threads Are A Bad Idea (for most purposes), September 1995.

[25]

J. K. Ousterhout, H. D. Costa, D. Harrison, J. A. Kunze, M. Kupfer, and J. G. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. In SOSP '85, pages 15--24, Orcas Island, WA, December 1985.

Digital Library

[26]

D. Patterson, G. Gibson, and R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). In SIGMOD '88, pages 109--116, Chicago, IL, June 1988.

Digital Library

[27]

R. H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed Prefetching and Caching. In SOSP '95, pages 79--95, Copper Mountain, CO, December 1995.

Digital Library

[28]

R. Pike. Another Go at Language Design. http://www.stanford.edu/class/ee380/Abstracts/100428.html, April 2010.

[29]

V. Prabhakaran, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Analysis and Evolution of Journaling File Systems. In USENIX '05, pages 105--120, Anaheim, CA, April 2005.

Digital Library

[30]

V. Prabhakaran, L. N. Bairavasundaram, N. Agrawal, H. S. Gunawi, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. IRON File Systems. In SOSP '05, pages 206--220, Brighton, UK, October 2005.

Digital Library

[31]

K. K. Ramakrishnan, P. Biswas, and R. Karedla. Analysis of File I/O Traces in Commercial Computing Environments. SIGMETRICS Perform. Eval. Rev., 20:78--90, June 1992.

Digital Library

[32]

D. M. Ritchie and K. Thompson. The Unix Time-Sharing System. In SOSP '73, Yorktown Heights, NY, October 1973.

Digital Library

[33]

D. Roselli, J. R. Lorch, and T. E. Anderson. A Comparison of File System Workloads. In USENIX '00, pages 41--54, San Diego, CA, June 2000.

Digital Library

[34]

M. Rosenblum and J. Ousterhout. The Design and Implementation of a Log-Structured File System. ACM Transactions on Computer Systems, 10(1):26--52, February 1992.

Digital Library

[35]

R. Sandberg. The Design and Implementation of the Sun Network File System. In Proceedings of the 1985 USENIX Summer Technical Conference, pages 119--130, Berkeley, CA, June 1985.

[36]

M. Satyanarayanan. A Study of File Sizes and Functional Lifetimes. In SOSP '81, pages 96--108, Pacific Grove, CA. December 1981.

Digital Library

[37]

A. Sweeney, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, and G. Peck. Scalability in the XFS File System. In USENIX 1996, San Diego, CA, January 1996.

Digital Library

[38]

M. Tilmann. Apple's Market Share In The PC World Continues To Surge, maclife.com, April 2010.

[39]

W. Vogels. File system usage in Windows NT 4.0. In SOSP '99, pages 93--109, Kiawah Island Resort, SC, December 1999.

Digital Library

[40]

S. C. Woo, M. Ohara, E. Torrie, J. P. Shingh, and A. Gupta. The SPLASH-2 Programs: Characterization and Methodological Considerations. In ISCA '95, pages 24--36, Santa Margherita Ligure, Italy, June 1995.

Digital Library

Cited By

Ryu JLee DShin KKang K(2025)Paralfetch: Fast Application Launch on Personal Computing/Communication DevicesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.352533736:4(616-632)Online publication date: Apr-2025
https://doi.org/10.1109/TPDS.2024.3525337
Ryu JLee DShin KKang KNaor DGoel A(2023)Fast application launch on personal computing/communication devicesProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585965(425-439)Online publication date: 21-Feb-2023
https://dl.acm.org/doi/10.5555/3585938.3585965
Wang YJia WJiang DXiong J(2023)A Survey of Non-Volatile Main Memory File SystemsJournal of Computer Science and Technology10.1007/s11390-023-1054-338:2(348-372)Online publication date: 30-Mar-2023
https://doi.org/10.1007/s11390-023-1054-3
Show More Cited By

Index Terms

A file is not a file: understanding the I/O behavior of Apple desktop applications
1. General and reference
  1. Cross-computing tools and techniques
    1. Performance
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
    2. Extra-functional properties
      1. Software performance

Recommendations

File system performance and transaction support
A multiple-file write scheme for improving write performance of small files in Fast File System

Fast File System (FFS) stores files to disk in separate disk writes, each of which incurs a disk positioning (seek + rotation) limiting the write performance for small files. We propose a new scheme called co-writing to accelerate small file writes in ...
The zebra striped network file system

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '11: Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles

October 2011

417 pages

ISBN:9781450309776

DOI:10.1145/2043556

General Chair:
Ted Wobber
MSR Silicon Valley
,
Program Chair:
Peter Druschel
MPI-SWS

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

INESC: Systems and Computer Engineering Institute
SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Division of Computer and Network Systems

Conference

SOSP '11

Sponsor:

INESC
SIGOPS

SOSP '11: ACM SIGOPS 23nd Symposium on Operating Systems Principles

October 23 - 26, 2011

Cascais, Portugal

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

68
Total Citations
View Citations
979
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ryu JLee DShin KKang K(2025)Paralfetch: Fast Application Launch on Personal Computing/Communication DevicesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.352533736:4(616-632)Online publication date: Apr-2025
https://doi.org/10.1109/TPDS.2024.3525337
Ryu JLee DShin KKang KNaor DGoel A(2023)Fast application launch on personal computing/communication devicesProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585965(425-439)Online publication date: 21-Feb-2023
https://dl.acm.org/doi/10.5555/3585938.3585965
Wang YJia WJiang DXiong J(2023)A Survey of Non-Volatile Main Memory File SystemsJournal of Computer Science and Technology10.1007/s11390-023-1054-338:2(348-372)Online publication date: 30-Mar-2023
https://doi.org/10.1007/s11390-023-1054-3
Li DZhang NDong MChen HOta KTang Y(2022)PM-AIO: An Effective Asynchronous I/O System for Persistent MemoryIEEE Transactions on Emerging Topics in Computing10.1109/TETC.2021.310904710:3(1558-1574)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TETC.2021.3109047
Liu JRebello ADai YYe CKannan SArpaci-Dusseau AArpaci-Dusseau R(2021)Scale and Performance in a Filesystem Semi-MicrokernelProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483581(819-835)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483581
Bijlani ARamachandran UCampbell R(2021)Where did my 256 GB go? A Measurement Analysis of Storage Consumption on Smart Mobile DevicesProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/34600955:2(1-28)Online publication date: 4-Jun-2021
https://dl.acm.org/doi/10.1145/3460095
Qiu YLiu HAnderson TLin YChen AAngel SKasikci BKohler E(2021)Toward reconfigurable kernel datapaths with learned optimizationsProceedings of the Workshop on Hot Topics in Operating Systems10.1145/3458336.3465288(175-182)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1145/3458336.3465288
Ren YMin CKannan SLu SHowell J(2020)CrossFSProceedings of the 14th USENIX Conference on Operating Systems Design and Implementation10.5555/3488766.3488774(137-154)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.5555/3488766.3488774
Akgun IKuenning GZadok E(2020)Re-AnimatorProceedings of the 13th ACM International Systems and Storage Conference10.1145/3383669.3398276(61-74)Online publication date: 30-May-2020
https://dl.acm.org/doi/10.1145/3383669.3398276
Tang CWan JZhu YLiu ZXu PWu FXie C(2019)RAFS: A RAID-Aware File System to Reduce the Parity Update Overhead for SSD RAID2019 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE.2019.8714938(1373-1378)Online publication date: Mar-2019
https://doi.org/10.23919/DATE.2019.8714938
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten