More Web Proxy on the site http://driver.im/

Article

Silver: a scalable, distributed, multi-versioning, always growing (Ag) file system

Authors:

Chris Rossbach,

Steven Swanson,

Dahlia MalkhiAuthors Info & Claims

HotStorage'16: Proceedings of the 8th USENIX Conference on Hot Topics in Storage and File Systems

Pages 56 - 60

Published: 20 June 2016 Publication History

Abstract

The storage needs of users have shifted from just needing to store data to requiring a rich interface which enables the efficient query of versions, snapshots and creation of clones. Providing these features in a distributed file system while maintaining scalability, strong consistency and performance remains a challenge. In this paper we introduce Silver, a file system which leverages the Corfu distributed logging system to not only store data, but to provide fast strongly consistent snapshots, clones and multi-versioning while preserving the scalability and performance of the distributed shared log. We describe and implement Silver using a FUSE prototype and show its performance characteristics.

References

[1]

Optical Storage Technology Association. Universal Disk Format Specification 2.60. 2005.

[2]

Mahesh Balakrishnan, Dahlia Malkhi, John D Davis, Vijayan Prabhakaran, Michael Wei, and Ted Wobber. Corfu: A distributed shared log. ACM Transactions on Computer Systems (TOCS), 31(4):10, 2013.

[3]

Mahesh Balakrishnan, Dahlia Malkhi, Ted Wobber, Ming Wu, Vijayan Prabhakaran, Michael Wei, John D Davis, Sriram Rao, Tao Zou, and Aviad Zuck. Tango: Distributed data structures over a shared log. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles, pages 325-340. ACM, 2013.

[4]

Dhruba Borthakur. Hdfs architecture guide. http: //hadoop.apache.org/common/docs/current/hdfsdesign.pdf, 2008.

[5]

John K Edwards, Daniel Ellard, Craig Everhart, Robert Fair, Eric Hamilton, Andy Kahn, Arkady Kanevsky, James Lentini, Ashish Prakash, Keith A Smith, et al. Flexvol: flexible, efficient file volume virtualization in wafl. In Usenix 2008 Annual Technical Conference, pages 129-142. USENIX Association, 2008.

[6]

John H. Hartman and John K. Ousterhout. Zebra: A striped network file system. Technical Report UCB/CSD-92-683, EECS Department, University of California, Berkeley, Apr 1992.

[7]

Ryusuke Konishi, Yoshiji Amagai, Koji Sato, Hisashi Hifumi, Seiji Kihara, and Satoshi Moriai. The linux implementation of a log-structured file system. ACM SIGOPS Operating Systems Review, 40(3):102-107, 2006.

[8]

Marshall K McKusick, William N Joy, Samuel J Leffler, and Robert S Fabry. A fast file system for unix. ACM Transactions on Computer Systems (TOCS), 2(3):181-197, 1984.

[9]

Sean Quinlan. A cached worm file system. Softw., Pract. Exper., 21(12):1289-1299, 1991.

[10]

Ohad Rodeh, Josef Bacik, and Chris Mason. Btrfs: The linux b-tree filesystem. ACM Transactions on Storage (TOS), 9(3):9, 2013.

[11]

Mendel Rosenblum and John K Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems (TOCS), 10(1):26-52, 1992.

[12]

Amy Tai, Michael Wei, Michael J. Freedman, Ittai Abraham, and Dahlia Malkhi. Replex: A scalable, highly available multiindex data store. In 2016 USENIX Annual Technical Conference (USENIX ATC 16), Denver, CO, June 2016. USENIX Association.

[13]

Alexander Thomson and Daniel J Abadi. Calvinfs: consistent wan replication and scalable metadata management for distributed file systems. In 13th USENIX Conference on File and Storage Technologies (FAST 15), pages 1-14, 2015.

[14]

Michael Wei, John D Davis, Ted Wobber, Mahesh Balakrishnan, and Dahlia Malkhi. Beyond block i/o: implementing a distributed shared log in hardware. In Proceedings of the 6th International Systems and Storage Conference, page 21. ACM, 2013.

[15]

Sage A Weil, Scott A Brandt, Ethan L Miller, Darrell DE Long, and Carlos Maltzahn. Ceph: A scalable, high-performance distributed file system. In Proceedings of the 7th symposium on Operating systems design and implementation, pages 307-320. USENIX Association, 2006.

[16]

Yiying Zhang, Leo Prasath Arulraj, Andrea C Arpaci-Dusseau, and Remzi H Arpaci-Dusseau. De-indirection for flash-based ssds with nameless writes. In FAST, page 1, 2012.

[17]

Yupu Zhang, Abhishek Rajimwale, Andrea C Arpaci-Dusseau, and Remzi H Arpaci-Dusseau. End-to-end data integrity for file systems: A zfs case study. In FAST, pages 29-42, 2010.

Cited By

Yeh TWang YTu Y(2020)Maintaining data integrity in cloud systems through version managementInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/ijahuc.2020.10781834:2(63-73)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1504/ijahuc.2020.107818
Lockerman JFaleiro JKim JSankaran SAbadi DAspnes JSen SBalakrishnan MArpaci-Dusseau AVoelker G(2018)The fuzzylogProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291195(357-372)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291195

Silver: a scalable, distributed, multi-versioning, always growing (Ag) file system

Recommendations

Silver metal organic chemical vapor deposition for advanced silver metallization

The use of silver interconnects enables higher speed for silicon integrated circuits. The formation of Ag interconnects requires sequential deposition of a continuous barrier layer followed by silver deposition and chemical-mechanical polishing (CMP). ...
Synthesis and antibacterial testing of silver/poly (ether amide) composite nanofibers with ultralow silver content

Antimicrobial materials have attracted much attention all over the world. Herein, a new kind of antimicrobial material, poly (ether amide) (Pebax) nanofibers containing Ag nanoparticles, was prepared by electrospinning method. The Ag/Pebax composites ...
Silver Nanoparticles Embedded in Natural Rubber Films

Natural rubber NR films can reduce silver metal ions forming embedded metal nanoparticles, a process that could be described as green synthesis. The NR films acting as a reactor generate and incorporate silver nanoparticles AgNPs. Organic acids and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

HotStorage'16: Proceedings of the 8th USENIX Conference on Hot Topics in Storage and File Systems

June 2016

120 pages

Program Chairs:
Nitin Agrawal
Samsung Research
,
Sam H. Noh
Ulsan National-Institute of Science and Technology

Sponsors

VMware
NetApp
Google Inc.
IBMR: IBM Research
Facebook: Facebook

Publisher

USENIX Association

United States

Publication History

Published: 20 June 2016

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yeh TWang YTu Y(2020)Maintaining data integrity in cloud systems through version managementInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/ijahuc.2020.10781834:2(63-73)Online publication date: 1-Jan-2020
https://dl.acm.org/doi/10.1504/ijahuc.2020.107818
Lockerman JFaleiro JKim JSankaran SAbadi DAspnes JSen SBalakrishnan MArpaci-Dusseau AVoelker G(2018)The fuzzylogProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291195(357-372)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291195

View Options

View options

Media

Figures

Other

Tables

View Table of Contents