More Web Proxy on the site http://driver.im/

research-article

StepAhead: Rethinking Filesystem Namespace Translations

Authors:

Debadatta Mishra,

Purushottam Kulkarni,

Raju RangaswamiAuthors Info & Claims

APSys '16: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems

Article No.: 16, Pages 1 - 8

https://doi.org/10.1145/2967360.2967370

Published: 04 August 2016 Publication History

Abstract

A hierarchical namespace is a common abstraction used for data organization within modern file systems. Fast translation of namespace objects to physical locations is necessary to carry out efficient file system operations. For reasons attributed to modularity, security, and to some extent legacy, namespace translations involves iterative translation of intervening directory objects from the root of the namespace. Namespace resolution is typically a multi-step process, potentially involving serialized I/O operations at each step.

In this paper, we propose a rethink of the strategy to fetch pathname entries. Our technique, StepAhead, proactively utilizes hints about namespace translation lookup failures to enable parallel and just-in-time fetching of necessary path translation data into memory to increase cache hits significantly. With StepAhead, we measure an increase in cache hit rates for path translation data across a set of six workloads by as much as 51%, which in turn results in application speed-up of as much as 20%.

References

[1]

Filebench. www.filebench.sourceforge.net/wiki/index.php/Main_Page.

[2]

Agrawal, N., Bolosky, W. J., Douceur, J. R., and Lorch, J. R. A five-year study of file-system metadata. Transaction on Storage 3, 3 (2007).

Digital Library

[3]

Beaver, D., Kumar, S., Li, H. C., Sobel, J., and Vajgel, P. Finding a needle in haystack: Facebook's photo storage. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) (2010), pp. 1--8.

Digital Library

[4]

Brandt, S. A., Miller, E. L., Long, D. D. E., and Xue, L. Efficient metadata management in large distributed storage systems. In Proceedings of IEEE conference on Mass Storage Systems and Technologies (MSST) (2003), pp. 290--298.

Digital Library

[5]

Cao, P., Felten, E. W., Karlin, A. R., and Li, K. A study of integrated prefetching and caching strategies. SIGMETRICS Performance Evaluation Review 23, 1 (1995), 188--197.

Digital Library

[6]

CloudByte. Moving metadata to flash memory. http://www.cloudbyte.com/wp-content/uploads/2015/05/Metadata-acceleration-CloudByte.pdf.

[7]

Ding, X., Jiang, S., Chen, F., Davis, K., and Zhang, X. Diskseen: Exploiting disk layout and access history to enhance i/o prefetch. In Proceedings of the USENIX Annual Technical Conference (2007), pp. 20:1--20:14.

Digital Library

[8]

Duchamp, D. Optimistic lookup of whole nfs paths in a single operation. In Proceedings of the USENIX Summer Technical Conference (UTSC) (1994).

Digital Library

[9]

Fengguang Wu, H. X., and Li, J. Linux readahead: less tricks for more. In Proceedings of Ottawa Linux Symposium (2007).

[10]

Fu, S., He, L., Huang, C., Liao, X., and Li, K. Performance optimization for managing massive numbers of small files in distributed file systems. IEEE Transactions on Parallel and Distributed Systems 26, 12 (2015), 3433--3448.

Digital Library

[11]

Ganger, G. R., and Kaashoek, M. F. Embedded inodes and explicit grouping: Exploiting disk bandwidth for small files. In Proceedings of the USENIX Annual Technical Conference (1997).

Digital Library

[12]

He, J., Bent, J., Torres, A., Grider, G., Gibson, G., Maltzahn, C., and Sun, X.-H. Io acceleration with pattern detection. In Proceedings of the International Symposium on High-performance Parallel and Distributed Computing (2013), pp. 25--36.

Digital Library

[13]

Jayaram, K. R., Peng, C., Zhang, Z., Kim, M., Chen, H., and Lei, H. An empirical analysis of similarity in virtual machine images. In Proceedings of the Middleware Industry Track Workshop (2011), pp. 6:1--6:6.

Digital Library

[14]

Lensing, P., Meister, D., and Brinkmann, A. hashfs: Applying hashing to optimize file systems for small file reads. In IEEE workshop on Storage Network Architecture and Parallel I/Os (SNAPI) (2010), pp. 33--42.

Digital Library

[15]

Lensing, P. H., Cortes, T., and Brinkmann, A. Direct lookup and hash-based metadata placement for local file systems. In Proceedings of Systems and Storage Conference (SYSTOR) (2013), pp. 5:1--5:11.

Digital Library

[16]

Mathur, A., Cao, M., Bhattacharya, S., Dilger, A., Tomas, A., Vivier, L., and S, B. S. A. The new ext4 filesystem: current status and future plans. In Proceedings of Ottawa Linux Symposium (2007).

[17]

Reimer, D., Thomas, A., Ammons, G., Mummert, T., Alpern, B., and Bala, V. Opening black boxes: Using semantic information to combat virtual machine image sprawl. In Proceedings of the Conference on Virtual Execution Environments (VEE) (2008), pp. 111--120.

Digital Library

[18]

Ren, K., and Gibson, G. Tablefs: Embedding a nosql database inside the local file system. In APMRC Digest (2012), pp. 1--6.

[19]

Ren, K., and Gibson, G. Tablefs: Enhancing metadata efficiency in the local file system. In Proceedings of the USENIX Annual Technical Conference (2013), pp. 145--156.

Digital Library

[20]

Richter, W., Ammons, G., Harkes, J., Goode, A., Bila, N., De Lara, E., Bala, V., and Satyanarayanan, M. Privacy-sensitive vm retrospection. In Proceedings of the USENIX Conference on Hot Topics in Cloud Computing (HotCloud) (2011).

Digital Library

[21]

Richter, W., Isci, C., Gilbert, B., Harkes, J., Bala, V., and Satyanarayanan, M. Agentless cloud-wide streaming of guest file system updates. In Proceedings of the nternational Conference on Cloud Engineering (IC2E) (2014), pp. 7--16.

Digital Library

[22]

Roselli, D., Lorch, J. R., and Anderson, T. E. A comparison of file system workloads. In Proceedings of the USENIX Annual Technical Conference (2000), pp. 1--15.

Digital Library

[23]

Smith, K. A., and Seltzer, M. I. File system aging---increasing the relevance of file system benchmarks. SIGMETRICS Performance Evaluation Review 25, 1 (1997), 203--213.

Digital Library

[24]

Suneja, S., Isci, C., de Lara, E., and Bala, V. Exploring vm introspection: Techniques and trade-offs. In Proceedings of the Conference on Virtual Execution Environments (VEE) (2015), pp. 133--146.

Digital Library

[25]

Tarasov, V., Jain, D., Hildebrand, D., Tewari, R., Kuenning, G., and Zadok, E. Improving i/o performance using virtual disk introspection. In Proceedings of the USENIX Conference on HotStorage (2013), pp. 1--5.

Digital Library

[26]

Tsai, C.-C., Zhan, Y., Reddy, J., Jiao, y., Zhang, T., and Porter, D. E. How to get more value from your file system directory cache. In Proceedings of Symposium on Operating Systems Principles (SOSP) (2015), pp. 441--456.

Digital Library

[27]

VanDeBogart, S., Frost, C., and Kohler, E. Reducing seek overhead with application-directed prefetching. In Proceedings of the USENIX Annual Technical Conference (2009).

Digital Library

[28]

Volos, H., Nalli, S., Panneerselvam, S., Varadarajan, V., Saxena, P., and Swift, M. M. Aerie: Flexible file-system interfaces to storage-class memory. In Proceedings of EuroSys (2014), pp. 14:1--14:14.

Digital Library

[29]

Weil, s. A., Brandt, S. A., Miller, E. L., Long, D. D. E., and Maltzahn, C. Ceph: A scalable, high-performance distributed file system. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) (2006), pp. 307--320.

Digital Library

[30]

Xing, J., Xiong, J., Sun, N., and Ma, J. Adaptive and scalable metadata management to support a trillion files. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis (2009), pp. 26:1--26:11.

Digital Library

[31]

Zhang, S., Catanese, H., and Wang, A.-I. A. The composite-file file system: Decoupling the one-to-one mapping of files and metadata for better performance. In Proceedings of the Usenix Conference on File and Storage Technologies (FAST) (2016), pp. 15--22.

Digital Library

[32]

Zhang, Z., and Ghose, K. hfs: A hybrid file system prototype for improving small file and metadata performance. SIGOPS Operating Systems Review 41, 3 (2007), 175--187.

Digital Library

[33]

Zhu, Y., Jiang, H., Wang, J., and Xian, F. Hba: Distributed metadata management for large cluster-based storage systems. IEEE Transactions on Parallel Distributed Systems 19, 6 (2008), 750--763.

Digital Library

Cited By

Zeng JXiao NLiu FZhu LLi YXing YLi S(2017)PTree: Direct Lookup with Page Table Tree for NVM File Systems2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech)10.1109/DASC-PICom-DataCom-CyberSciTec.2017.186(1160-1167)Online publication date: Nov-2017
https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2017.186

StepAhead: Rethinking Filesystem Namespace Translations
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

TLB Improvements for Chip Multiprocessors: Inter-Core Cooperative Prefetchers and Shared Last-Level TLBs

Translation Lookaside Buffers (TLBs) are critical to overall system performance. Much past research has addressed uniprocessor TLBs, lowering access times and miss rates. However, as Chip MultiProcessors (CMPs) become ubiquitous, TLB design and ...
SELECTIVE VICTIM CACHING: A METHOD TO IMPROVE THE PERFORMANCE OF DIRECT-MAPPED CACHES
High performance cache replacement using re-reference interval prediction (RRIP)
ISCA '10

Practical cache replacement policies attempt to emulate optimal replacement by predicting the re-reference interval of a cache block. The commonly used LRU replacement policy always predicts a near-immediate re-reference interval on cache hits and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

APSys '16: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems

August 2016

169 pages

ISBN:9781450342650

DOI:10.1145/2967360

General Chairs:
Heming Cui,
Francis C.M. Lau,
Program Chairs:
Sorav Bansal,
Lin Zhong

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 August 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

APSys '16

Sponsor:

SIGOPS

APSys '16: 7th ACM SIGOPS Asia-Pacific Workshop on Systems

August 4 - 5, 2016

Hong Kong, Hong Kong

Acceptance Rates

Overall Acceptance Rate 169 of 430 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
173
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zeng JXiao NLiu FZhu LLi YXing YLi S(2017)PTree: Direct Lookup with Page Table Tree for NVM File Systems2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech)10.1109/DASC-PICom-DataCom-CyberSciTec.2017.186(1160-1167)Online publication date: Nov-2017
https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2017.186

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents