More Web Proxy on the site http://driver.im/

research-article

Hi-ZNS: High Space Efficiency and Zero-Copy LSM-Tree Based Stores on ZNS SSDs

Authors:

Duo LiuAuthors Info & Claims

ICPP '24: Proceedings of the 53rd International Conference on Parallel Processing

Pages 1217 - 1226

https://doi.org/10.1145/3673038.3673096

Published: 12 August 2024 Publication History

Abstract

The Zoned Namespace (ZNS) SSD is a newly introduced storage device and provides several new ZNS commands to upper-level applications. Zone-reset command is one of the ZNS commands to erase all the flash blocks within a zone. Since data is grouped and erased in zone units, ZNS SSDs are widely used in LSM-tree-based stores. However, the basic invalidated unit in LSM-tree is an SST/WAL file, which mismatches the erasing unit of a ZNS SSD. Placing different SST/WAL files in the same zone, LSM-tree on ZNS SSDs faces dramatic space amplification and extensive data migration problems.

To solve these problems, Hi-ZNS aligns zone sizes with varying-sizes SST/WAL files without changing the ZNS specification. The basic idea of Hi-ZNS is to put an SST/WAL file in a single zone. When an SST/WAL is invalidated, upper-level applications with Hi-ZNS send the zone-reset command to a ZNS SSD device mindlessly without any space amplification and data migration. Specifically, Hi-ZNS allocates physical resources for the zone on demand and provides an infinite logical zone number to avoid wasting storage resources. The extensive evaluation demonstrates that Hi-ZNS substantially improves space efficiency and completely eliminates data migration. Compared with the existing ZenFS&RocksDB, Hi-ZNS increases the maximum completed requests by up to 2.97 × and improves the I/O performance by up to 7%.

References

[1]

Hanyeoreum Bae, Jiseon Kim, Miryeong Kwon, and Myoungsoo Jung. 2022. What you can’t forget: exploiting parallelism for zoned namespaces. In Proceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems. 79–85.

Digital Library

[2]

Matias Bjørling, Abutalib Aghayev, Hans Holmberg, Aravind Ramesh, Damien Le Moal, Gregory R Ganger, and George Amvrosiadis. 2021. ZNS: Avoiding the block interface tax for flash-based SSDs. In 2021 USENIX Annual Technical Conference (USENIX ATC’21). 689–703.

[3]

Sungjin Byeon, Joseph Ro, Safdar Jamil, Jeong-Uk Kang, and Youngjae Kim. 2023. A free-space adaptive runtime zone-reset algorithm for enhanced ZNS efficiency. In Proceedings of the 15th ACM Workshop on Hot Topics in Storage and File Systems. 109–115.

Digital Library

[4]

Gunhee Choi, Kwanghee Lee, Myunghoon Oh, Jongmoo Choi, Jhuyeong Jhin, and Yongseok Oh. 2020. A New LSM-style Garbage Collection Scheme for ZNS SSDs. In 12th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 20).

[5]

Jinhua Cui, Youtao Zhang, Liang Shi, Chun Jason Xue, Weiguo Wu, and Jun Yang. 2017. Approxftl: On the performance and lifetime improvement of 3-d nand flash-based ssds. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) 37, 10 (2017), 1957–1970.

Digital Library

[6]

Siying Dong, Andrew Kryczka, Yanqin Jin, and Michael Stumm. 2021. Rocksdb: Evolution of development priorities in a key-value store serving large-scale applications. ACM Transactions on Storage (TOS) 17, 4 (2021), 1–32.

Digital Library

[7]

Kyuhwa Han, Hyunho Gwak, Dongkun Shin, and Jooyoung Hwang. 2021. ZNS+: Advanced zoned namespace interface for supporting in-storage zone compaction. In 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI’21). 147–162.

[8]

Yejin Han, Myunghoon Oh, Jaedong Lee, Seehwan Yoo, Bryan S Kim, and Jongmoo Choi. 2023. Achieving Performance Isolation in Docker Environments with ZNS SSDs. In 2023 IEEE 12th Non-Volatile Memory Systems and Applications Symposium (NVMSA). IEEE, 25–31.

[9]

Dong Huang, Dan Feng, Qiankun Liu, Bo Ding, Wei Zhao, Xueliang Wei, and Wei Tong. 2023. SplitZNS: Towards an efficient LSM-tree on zoned namespace SSDs. ACM Transactions on Architecture and Code Optimization 20, 3 (2023), 1–26.

Digital Library

[10]

Cheng Ji, Li-Pin Chang, Liang Shi, Chao Wu, Qiao Li, and Chun Jason Xue. 2016. An empirical study of File-System fragmentation in mobile storage systems. In 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16).

Digital Library

[11]

Jeeyoon Jung and Dongkun Shin. 2022. Lifetime-leveling LSM-tree compaction for ZNS SSD. In Proceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems (HotStorage’22). 100–105.

Digital Library

[12]

Hee-Rock Lee, Chang-Gyu Lee, Seungjin Lee, and Youngjae Kim. 2022. Compaction-aware zone allocation for LSM based key-value store on ZNS SSDs. In Proceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems. 93–99.

Digital Library

[13]

Biyong Liu, Yuan Xia, Xueliang Wei, and Wei Tong. 2023. LifetimeKV: Narrowing the Lifetime Gap of SSTs in LSMT-based KV Stores for ZNS SSDs. In 2023 IEEE 41st International Conference on Computer Design (ICCD). IEEE, 300–307.

[14]

Renping Liu, Zhenhua Tan, Yan Shen, Linbo Long, and Duo Liu. 2022. Fair-zns: Enhancing fairness in zns ssds through self-balancing I/O scheduling. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (2022).

[15]

Linbo Long, Shuiyong He, Jingcheng Shen, Renping Liu, Zhenhua Tan, Congming Gao, Duo Liu, Kan Zhong, and Yi Jiang. 2024. WA-Zone: Wear-Aware Zone Management Optimization for LSM-Tree on ZNS SSDs. ACM Transactions on Architecture and Code Optimization 21, 1 (2024), 1–23.

Digital Library

[16]

Mingchen Lu, Peiquan Jin, Xiaoliang Wang, Yongping Luo, and Kuankuan Guo. 2023. ZoneKV: A Space-Efficient Key-Value Store for ZNS SSDs. In 2023 60th ACM/IEEE Design Automation Conference (DAC’23). IEEE, 1–6.

[17]

Jaehong Min, Chenxingyu Zhao, Ming Liu, and Arvind Krishnamurthy. 2023. eZNS: An Elastic Zoned Namespace for Commodity { ZNS}{ SSDs}. In 17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23). 461–477.

[18]

Devashish Purandare, Pete Wilcox, Heiner Litz, and Shel Finkelstein. 2022. Append is near: Log-based data management on zns ssds. In 12th Annual Conference on Innovative Data Systems Research (CIDR’22).

[19]

Dongjoo Seo, Ping-Xiang Chen, Huaicheng Li, Matias Bjørling, and Nikil Dutt. 2023. Is garbage collection overhead gone? case study of F2FS on ZNS SSDs. In Proceedings of the 15th ACM Workshop on Hot Topics in Storage and File Systems. 102–108.

Digital Library

[20]

Zhenhua Tan, Linbo Long, Renping Liu, Congming Gao, Yi Jiang, and Yan Liu. 2023. Optimizing Data Migration for Garbage Collection in ZNS SSDs. In 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 1–2.

[21]

Yu Wang, You Zhou, Zhonghai Lu, Xiaoyi Zhang, Kun Wang, Feng Zhu, Shu Li, Changsheng Xie, and Fei Wu. 2023. FlexZNS: Building High-Performance ZNS SSDs with Size-Flexible and Parity-Protected Zones. In 2023 IEEE 41st International Conference on Computer Design (ICCD). IEEE, 291–299.

[22]

Chao Wu, Cheng Ji, Qiao Li, Congming Gao, Riwei Pan, Chenchen Fu, Liang Shi, and Chun Jason Xue. 2019. Maximizing I/O throughput and minimizing performance variation via reinforcement learning based I/O merging for SSDs. IEEE Trans. Comput. 69, 1 (2019), 72–86.

Digital Library

[23]

Denghui Wu, Biyong Liu, Wei Zhao, and Wei Tong. 2022. Znskv: Reducing data migration in lsmt-based kv stores on zns ssds. In 2022 IEEE 40th International Conference on Computer Design (ICCD). IEEE, 411–414.

Cited By

Nie SLei TNiu JHu QLiu SWu W(2025)Time-constrained persistent deletion for key–value store engine on ZNS SSDFuture Generation Computer Systems10.1016/j.future.2024.107598164(107598)Online publication date: Mar-2025
https://doi.org/10.1016/j.future.2024.107598
Lee CLee SMoon GKim HAn DKang D(2024)ReZNS: Energy and Performance-Optimal Mapping Mechanism for ZNS SSDApplied Sciences10.3390/app1421971714:21(9717)Online publication date: 24-Oct-2024
https://doi.org/10.3390/app14219717

Index Terms

Index terms have been assigned to the content through auto-classification.

Recommendations

Towards Read-Intensive Key-Value Stores with Tidal Structure Based on LSM-Tree
ASPDAC '20: Proceedings of the 25th Asia and South Pacific Design Automation Conference

Key-value store has played a critical role in many large-scale data storage applications. The log-structured merge-tree (LSM-tree) based key-value store achieves excellent performance on write-intensive workloads which is mainly benefited from the ...
Lifetime-leveling LSM-tree compaction for ZNS SSD
HotStorage '22: Proceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems

The Log-Structured Merge (LSM) tree is considered well-suited to zoned namespace (ZNS) storage devices since the write requests to LSM-tree is sequential. However, zones can be partially invalidated and be fragmented during LSM-tree compaction. The ...
LSM-tree managed storage for large-scale key-value store
SoCC '17: Proceedings of the 2017 Symposium on Cloud Computing

Key-value stores are increasingly adopting LSM-trees as their enabling data structure in the backend storage, and persisting their clustered data through a file system. A file system is expected to not only provide file/directory abstraction to organize ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICPP '24: Proceedings of the 53rd International Conference on Parallel Processing

August 2024

1279 pages

ISBN:9798400717932

DOI:10.1145/3673038

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 August 2024

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICPP '24

ICPP '24: the 53rd International Conference on Parallel Processing

August 12 - 15, 2024

Gotland, Sweden

Acceptance Rates

Overall Acceptance Rate 91 of 313 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
170
Total Downloads

Downloads (Last 12 months)170
Downloads (Last 6 weeks)38

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nie SLei TNiu JHu QLiu SWu W(2025)Time-constrained persistent deletion for key–value store engine on ZNS SSDFuture Generation Computer Systems10.1016/j.future.2024.107598164(107598)Online publication date: Mar-2025
https://doi.org/10.1016/j.future.2024.107598
Lee CLee SMoon GKim HAn DKang D(2024)ReZNS: Energy and Performance-Optimal Mapping Mechanism for ZNS SSDApplied Sciences10.3390/app1421971714:21(9717)Online publication date: 24-Oct-2024
https://doi.org/10.3390/app14219717

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents