short-paper

Hockey: A Hybrid PMem-SSD Storage Engine for Analytical Database

Authors:

Yuhang Jia,

Huiqi Hu,

Xuan Zhou,

Weining QianAuthors Info & Claims

CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge Management

Pages 4877 - 4881

https://doi.org/10.1145/3511808.3557165

Published: 17 October 2022 Publication History

Get Access

Abstract

Storage engines for analytic databases are being developed to be setup with different devices for both cost price and performance considerations. Persistent Memory(PMem), as a novel storage device, also provides a new promising option for the hybrid storage. In this demonstration, we introduce Hockey, an efficient columnar storage engine designed for hybrid PMem-SSD storage. We first go through the design of the system and introduce how the data and meta data are structured and accessed on the PMem. The system's data placement strategy on hybrid storage is then presented. To highlight Hockey's design concerns for the hybrid storage as well as its superior performance, we develop a visual interface to demonstrate the system through three scenarios.

Supplementary Material

MP4 File (CIKM22-demo030.mp4)

In this video, we introduce Hockey, an efficient columnar storage engine designed for hybrid PMem-SSD storage.

Download
9.81 MB

References

[1]

Maximilian Böther, Otto Kißig, Lawrence Benson, and Tilmann Rabl. 2021. Drop It In Like It's Hot: An Analysis of Persistent Memory as a Drop-in Replacement for NVMe SSDs. In Proceedings of the 17th International Workshop on Data Management on New Hardware (DaMoN 2021). 1--8.

Digital Library

Google Scholar

[2]

Gil Einziger, Roy Friedman, and Ben Manes. 2017. TinyLFU: A Highly Efficient Cache Admission Policy. ACM Trans. Storage, Vol. 13, 4 (2017), 35:1--35:31. https://doi.org/10.1145/3149371

Digital Library

Google Scholar

[3]

Ian Neal, Gefei Zuo, Eric Shiple, Tanvir Ahmed Khan, Youngjin Kwon, Simon Peter, and Baris Kasikci. 2021. Rethinking File Mapping for Persistent Memory. In 19th USENIX Conference on File and Storage Technologies, FAST 2021, February 23--25, 2021, Marcos K. Aguilera and Gala Yadgar (Eds.). USENIX Association, 97--111. https://www.usenix.org/conference/fast21/presentation/neal

Google Scholar

[4]

Patrick O'Neil, Elizabeth O'Neil, Xuedong Chen, and Stephen Revilak. 2009. The star schema benchmark and augmented fact table indexing. In Technology Conference on Performance Evaluation and Benchmarking. Springer, 237--252.

Digital Library

Google Scholar

[5]

ClickHouse Team. 2022. ClickHouse. https://clickhouse.com/

Google Scholar

[6]

Yinjun Wu, Kwanghyun Park, Rathijit Sen, Brian Kroth, and Jaeyoung Do. 2020. Lessons learned from the early performance evaluation of Intel Optane DC Persistent Memory in DBMS. In Proceedings of the 16th International Workshop on Data Management on New Hardware. 1--3.

Digital Library

Google Scholar

[7]

Baoyue Yan, Xuntao Cheng, Bo Jiang, Shibin Chen, Canfang Shang, Jianying Wang, Gui Huang, Xinjun Yang, Wei Cao, and Feifei Li. 2021. Revisiting the design of LSM-tree Based OLTP storage engine with persistent memory. Proceedings of the VLDB Endowment, Vol. 14, 10 (2021), 1872--1885.

Digital Library

Google Scholar

[8]

Jian Yang, Juno Kim, Morteza Hoseinzadeh, Joseph Izraelevitz, and Steve Swanson. 2020. An empirical guide to the behavior and use of scalable persistent memory. In 18th USENIX Conference on File and Storage Technologies (FAST 20). 169--182.

Digital Library

Google Scholar

[9]

Ting Yao, Yiwen Zhang, Jiguang Wan, Qiu Cui, Liu Tang, Hong Jiang, Changsheng Xie, and Xubin He. 2020. MatrixKV: Reducing Write Stalls and Write Amplification in LSM-tree Based KV Stores with Matrix Container in NVM. In 2020 USENIX Annual Technical Conference, USENIX ATC 2020, July 15--17, 2020, Ada Gavrilovska and Erez Zadok (Eds.). USENIX Association, 17--31. https://www.usenix.org/conference/atc20/presentation/yao

Google Scholar

Cited By

View all

Luo ZWang QWang HQu TLi MGu RDai H(2023)MoonKV: Optimizing Update-intensive Workloads for NVM-based Key-value Stores2023 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM58522.2023.00057(478-487)Online publication date: 1-Dec-2023
https://doi.org/10.1109/ICDM58522.2023.00057

Index Terms

Hockey: A Hybrid PMem-SSD Storage Engine for Analytical Database
1. Information systems
  1. Data management systems

Recommendations

Use case study of HDD-SSD hybrid storage, distributed storage and HDD storage on OpenStack
IDEAS '15: Proceedings of the 19th International Database Engineering & Applications Symposium

For typical IaaS cloud usage, frequent provisioning of virtual volumes is needed. However, performance of HDD storage is not sufficient and becomes bottleneck in IaaS cloud. In this paper, we studied a comparison of HDD-SSD hybrid storage, distributed ...
A flash-based decomposition storage model
DASFAA'12: Proceedings of the 17th international conference on Database Systems for Advanced Applications

The traditional HDD-based columnar storage is an important technology to improve the performance of query-intensive database. However, some features of HDD weaken the advantages of columnar storage. In this paper, we study the advantages of SSD over HDD ...
SpacKV: A Pmem-Aware Key-Value Separation Store Based on LSM-Tree
Network and Parallel Computing
Abstract
Key-value (KV) stores based on persistent memories such as Intel Optane Pmem can deliver higher throughput and lower latency, compared to traditional SSD/HDD. Many KV stores adopt LSM-tree as the bone index structure. However, LSM-tree suffers ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge Management

October 2022

5274 pages

ISBN:9781450392365

DOI:10.1145/3511808

General Chairs:
Mohammad Al Hasan
Indiana University Purdue University, Indianapolis, USA
,
Li Xiong
Emory University, Atlanta, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

National Science Foundation of China

Conference

CIKM '22

Sponsor:

CIKM '22: The 31st ACM International Conference on Information and Knowledge Management

October 17 - 21, 2022

GA, Atlanta, USA

Acceptance Rates

CIKM '22 Paper Acceptance Rate 621 of 2,257 submissions, 28%;

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
164
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)3

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Luo ZWang QWang HQu TLi MGu RDai H(2023)MoonKV: Optimizing Update-intensive Workloads for NVM-based Key-value Stores2023 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM58522.2023.00057(478-487)Online publication date: 1-Dec-2023
https://doi.org/10.1109/ICDM58522.2023.00057

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Use case study of HDD-SSD hybrid storage, distributed storage and HDD storage on OpenStack

A flash-based decomposition storage model

SpacKV: A Pmem-Aware Key-Value Separation Store Based on LSM-Tree