More Web Proxy on the site http://driver.im/

research-article

Efficient compute node-local replication mechanisms for NVRAM-centric data structures

Authors:

Mikhail Zarubin,

Thomas Kissinger,

Wolfgang LehnerAuthors Info & Claims

DAMON '18: Proceedings of the 14th International Workshop on Data Management on New Hardware

Article No.: 7, Pages 1 - 9

https://doi.org/10.1145/3211922.3211931

Published: 11 June 2018 Publication History

Abstract

Non-volatile random-access memory (NVRAM) is about to hit the market and will require significant changes to the architecture of in-memory database systems. Since such hybrid DRAM-NVRAM database systems will keep the primary data solely persistent in the NVRAM, efficient replication mechanisms need to be considered to prevent data losses and to guarantee high availability in case of NVDIMM failures. In this paper, we argue for a software-based replication approach and present compute node-local mechanisms to provide the building blocks for an efficient NVRAM replication with a low latency and throughput penalty. Within our evaluation, we measured up to 10x less overhead for our optimized replication mechanisms compared to the basic replication mechanism of the Intel persistent memory development kit (PMDK).

References

[1]

Alfons Kemper Thomas Neumann Takushi Hashida Kazuichi Oe Yoshiyasu Doi Lilian Harada Sato Mitsuru Alexander van Renen, Viktor Leis. 2018. Managing Non-Volatile Memory in Database Systems. In Proceedings of the 2018 SIGMOD International Conference on Management of Data, June, 2018, Houston. 691--706.

Digital Library

[2]

Joy Arulraj, Matthew Perron, and Andrew Pavlo. 2016. Write-Behind Logging. PVLDB 10, 4 (2016), 337--348. http://www.vldb.org/pvldb/vol10/p337-arulraj.pdf

Digital Library

[3]

Kumud Bhandari, Dhruva R. Chakrabarti, and Hans-Juergen Boehm. 2016. Makalu: Fast Recoverable Allocation of Non-volatile Memory. In Proceedings of the 2016 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications, OOPSLA 2016, part of SPLASH 2016, Amsterdam, The Netherlands, October 30 - November 4, 2016. 677--694.

Digital Library

[4]

Shimin Chen, Phillip B. Gibbons, and Suman Nath. 2011. Rethinking Database Algorithms for Phase Change Memory. In CIDR 2011, Fifth Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 9--12, 2011, Online Proceedings. 21--31. http://cidrdb.org/cidr2011/Papers/CIDR11_Paper3.pdf

[5]

Shimin Chen and Qin Jin. 2015. Persistent B+-Trees in Non-Volatile Main Memory. PVLDB 8, 7 (2015), 786--797. http://www.vldb.org/pvldb/vol8/p786-chen.pdf

Digital Library

[6]

Rohit Dhamane, Marta Patiño-Martínez, Valerio Vianello, and Ricardo Jiménez-Peris. 2014. Performance Evaluation of Database Replication Systems. In 18th International Database Engineering & Applications Symposium, IDEAS 2014, Porto, Portugal, July 7--9, 2014. 288--293.

Digital Library

[7]

Jinwei Guo, Chendong Zhang, Peng Cai, Minqi Zhou, and Aoying Zhou. 2016. Low Overhead Log Replication for Main Memory Database System. In Web-Age Information Management - 17th International Conference, WAIM 2016, Nanchang, China, June 3--5, 2016, Proceedings, Part II. 159--170.

[8]

Intel. 2018. Intel Instruction Reference Manual (Vol 2A, 3--147). (2018).

[9]

Tomasz Kapela. 2015. An introduction to replication. (2015). http://pmem.io/2015/11/23/replication-intro.html.

[10]

Hideaki Kimura. 2015. FOEDUS: OLTP Engine for a Thousand Cores and NVRAM. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Melbourne, Victoria, Australia, May 31 - June 4, 2015. 691--706.

Digital Library

[11]

Iulian Moraru, David G. Andersen, Michael Kaminsky, Niraj Tolia, Parthasarathy Ranganathan, and Nathan Binkert. 2013. Consistent, Durable, and Safe Memory Management for Byte-addressable Non Volatile Main Memory. In Proceedings of the First ACM SIGOPS Conference on Timely Results in Operating Systems (TRIOS '13). ACM, New York, NY, USA, Article 1, 17 pages.

Digital Library

[12]

Ismail Oukid, Daniel Booss, Wolfgang Lehner, Peter Bumbulis, and Thomas Willhalm. 2014. SOFORT: A Hybrid SCM-DRAM Storage Engine for Fast Data Recovery. In Tenth International Workshop on Data Management on New Hardware, DaMoN 2014, Snowbird, UT, USA, June 23, 2014. 8:1--8:7.

Digital Library

[13]

Ismail Oukid, Daniel Booss, Adrien Lespinasse, Wolfgang Lehner, Thomas Willhalm, and Grégoire Gomes. 2017. Memory Management Techniques for Large-Scale Persistent-Main-Memory Systems. PVLDB 10, 11 (2017), 1166--1177. http://www.vldb.org/pvldb/vol10/p1166-oukid.pdf

Digital Library

[14]

Ismail Oukid, Johan Lasperas, Anisoara Nica, Thomas Willhalm, and Wolfgang Lehner. 2016. FPTree: A Hybrid SCM-DRAM Persistent and Concurrent B-Tree for Storage Class Memory. In Proceedings of the 2016 International Conference on Management of Data (SIGMOD '16). ACM, New York, NY, USA, 371--386.

Digital Library

[15]

Ismail Oukid and Wolfgang Lehner. 2017. Data Structure Engineering For Byte-Addressable Non-Volatile Memory. In Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD '17). ACM, New York, NY, USA, 1759--1764.

Digital Library

[16]

Ismail Oukid and Wolfgang Lehner. 2017. Towards a Single-Level Database Architecture on Non-Volatile Memory. In 8th Annual Non-Volatile Memories Workshop 2017 (NVMW).

[17]

Ismail Oukid, Wolfgang Lehner, Thomas Kissinger, Thomas Willhalm, and Peter Bumbulis. 2015. Instant Recovery for Main Memory Databases. In CIDR 2015, Seventh Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4--7, 2015, Online Proceedings. http://cidrdb.org/cidr2015/Papers/CIDR15_Paper13.pdf

[18]

Andy Rudoff. 2015. Persistent Memory Programming. Login: The Usenix Magazine 42 (2015), 34--40.

[19]

Vasily A. Sartakov and Rüdiger Kapitza. 2017. Multi-site Synchronous VM Replication for Persistent Systems with Asymmetrie Read/Write Latencies. In 22nd IEEE Pacific Rim International Symposium on Dependable Computing, PRDC 2017, Christchurch, New Zealand, January 22--25, 2017. 195--204.

[20]

David Schwalb, Tim Berning, Martin Faust, Markus Dreseler, and Hasso Plattner. 2015. nvm malloc: Memory Allocation for NVRAM. In ADMS@VLDB.

[21]

Shivaram Venkataraman, Niraj Tolia, Parthasarathy Ranganathan, and Roy H. Campbell. 2011. Consistent and Durable Data Structures for Non-volatile Byte-addressable Memory. In Proceedings of the 9th USENIX Conference on File and Stroage Technologies (FAST'11). USENIX Association, Berkeley, CA, USA, 5--5. http://dl.acm.org/citation.cfm?id=1960475.1960480

Digital Library

[22]

Stratis Viglas. 2014. Write-limited sorts and joins for persistent memory. PVLDB 7, 5 (2014), 413--424. http://www.vldb.org/pvldb/vol7/p413-viglas.pdf

Digital Library

[23]

Tianzheng Wang, Ryan Johnson, and Ippokratis Pandis. 2017. Query Fresh: Log Shipping on Steroids. Proc. VLDB Endow. 11, 4 (Dec. 2017), 406--419.

Digital Library

[24]

Jun Yang, Qingsong Wei, Chundong Wang, Cheng Chen, Khai Leong Yong, and Bingsheng He. 2016. NV-Tree: A Consistent and Workload-Adaptive Tree Structure for Non-Volatile Memory. IEEE Trans. Computers 65, 7 (2016), 2169--2183.

[25]

Songping Yu, Nong Xiao, Mingzhu Deng, Yuxuan Xing, Fang Liu, Zhiping Cai, and Wei Chen. 2015. WAlloc: An efficient wear-aware allocator for non-volatile main memory. In 34th IEEE International Performance Computing and Communications Conference, IPCCC 2015, Nanjing, China, December 14--16, 2015. 1--8.

Digital Library

[26]

Yiying Zhang, Jian Yang, Amirsaman Memaripour, and Steven Swanson. 2015. Mojim: A Reliable and Highly-Available Non-Volatile Memory System. SIGARCH Comput. Archit. News 43, 1 (March 2015), 3--18.

Digital Library

Cited By

Zarubin MDamme PKrause AHabich DLehner WWassermann BMalka MChidambaram VRaz D(2021)SIMD-MIMD cocktail in a hybrid memory glassProceedings of the 14th ACM International Conference on Systems and Storage10.1145/3456727.3463782(1-12)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1145/3456727.3463782
Ha MKim S(2020)InK: In-Kernel Key-Value Storage with Persistent MemoryElectronics10.3390/electronics91119139:11(1913)Online publication date: 13-Nov-2020
https://doi.org/10.3390/electronics9111913
Gill GDathathri RHoang LPeri RPingali K(2020)Single machine graph analytics on massive datasets using Intel optane DC persistent memoryProceedings of the VLDB Endowment10.14778/3389133.338914513:8(1304-1318)Online publication date: 3-May-2020
https://dl.acm.org/doi/10.14778/3389133.3389145
Show More Cited By

Index Terms

Efficient compute node-local replication mechanisms for NVRAM-centric data structures
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Main memory engines
  2. Information storage systems
    1. Information storage technologies
      1. Storage class memory
    2. Storage replication

Recommendations

Integer Compression in NVRAM-centric Data Stores: Comparative Experimental Analysis to DRAM
DaMoN'19: Proceedings of the 15th International Workshop on Data Management on New Hardware

Lightweight integer compression algorithms play an important role in in-memory database systems to tackle the growing gap between processor speed and main memory bandwidth. Thus, there is a large number of algorithms to choose from, while different ...
Ouroboros Wear Leveling for NVRAM Using Hierarchical Block Migration
Special Issue on MSST 2017 and Regular Papers

Emerging nonvolatile RAM (NVRAM) technologies have a limit on the number of writes that can be made to any cell, similar to the erasure limits in NAND Flash. This motivates the need for wear leveling techniques to distribute the writes evenly among the ...
DRAMPersist: Making DRAM Systems Persistent
MEMSYS '16: Proceedings of the Second International Symposium on Memory Systems

Modern applications exercise main memory systems in different ways. A lot of scale-out, in-memory applications exploit a number of desirable properties provided by DRAM such as high capacity, low latency and high bandwidth. Although DRAM technology ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DAMON '18: Proceedings of the 14th International Workshop on Data Management on New Hardware

June 2018

75 pages

ISBN:9781450358538

DOI:10.1145/3211922

Conference Chairs:
Wolfgang Lehner
Technische Universität Dresden
,
Ken Salem
University of Waterloo

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German Research Foundation (DFG)

Conference

SIGMOD/PODS '18

Sponsor:

SIGMOD

SIGMOD/PODS '18: International Conference on Management of Data

June 11, 2018

Texas, Houston

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
212
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zarubin MDamme PKrause AHabich DLehner WWassermann BMalka MChidambaram VRaz D(2021)SIMD-MIMD cocktail in a hybrid memory glassProceedings of the 14th ACM International Conference on Systems and Storage10.1145/3456727.3463782(1-12)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1145/3456727.3463782
Ha MKim S(2020)InK: In-Kernel Key-Value Storage with Persistent MemoryElectronics10.3390/electronics91119139:11(1913)Online publication date: 13-Nov-2020
https://doi.org/10.3390/electronics9111913
Gill GDathathri RHoang LPeri RPingali K(2020)Single machine graph analytics on massive datasets using Intel optane DC persistent memoryProceedings of the VLDB Endowment10.14778/3389133.338914513:8(1304-1318)Online publication date: 3-May-2020
https://dl.acm.org/doi/10.14778/3389133.3389145
Zarubin MDamme PKissinger THabich DLehner WWillhalm T(2019)Integer Compression in NVRAM-centric Data StoresProceedings of the 15th International Workshop on Data Management on New Hardware10.1145/3329785.3329923(1-11)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3329785.3329923

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents