More Web Proxy on the site http://driver.im/

research-article

Improving CPU I/O Performance via SSD Controller FTL Support for Batched Writes

Authors:

Ivan Luiz PicoliAuthors Info & Claims

DaMoN'19: Proceedings of the 15th International Workshop on Data Management on New Hardware

Article No.: 2, Pages 1 - 8

https://doi.org/10.1145/3329785.3329925

Published: 01 July 2019 Publication History

Abstract

Exploiting a storage hierarchy is critical to cost-effective data management. One can achieve great performance when working solely on main memory data. But this comes at a high cost. Systems that use secondary storage as the "home" for data have much lower storage costs as they can not only make the data durable but reduce its storage cost as well. Performance then becomes the challenge, reflected in an increased execution cost. Log structured stores, e.g. Deuteronomy, improve I/O cost/performance by batching writes. However, this incurs the cost of host-based garbage collection and recovery, which duplicates SSD flash translation layer (FTL) functionality. This paper describes the design and implementation in a controller for an Open Channel SSD of a new FTL that supports multi-page I/O without host-based log structuring. This both simplifies the host system and improves performance. The new FTL improves I/O cost/performance with only modest change to the current block at a time, update-in-place interface.

References

[1]

M. Bjørling, J. González, and P. Bonnet. Lightnvm: The linux open-channel ssd subsystem. In FAST, pages 359--374, 2017.

Digital Library

[2]

P. Bonnet. What's up with the storage hierarchy? In CIDR, 2017.

[3]

T.-S. Chung, D.-J. Park, S. Park, D.-H. Lee, S.-W. Lee, and H.-J. Song. A survey of flash translation layer. Journal of Systems Architecture, 55(5-6):332--343, 2009.

Digital Library

[4]

B. Cooper, A. Silberstein, E. Tam, R. Ramakrrishnan and R. Sears. Benchmarking cloud serving systems with YCSB. In SoCC, pages 143--154, 2010.

Digital Library

[5]

M. Cornwell. Anatomy of a solid-state drive. Commun. ACM, 55(12):59--63, 2012.

Digital Library

[6]

C. Diaconu, C. Freedman, E. Ismert, P.-A. Larson, P. Mittal, R. Stonecipher, N. Verma, and M. Zwilling. Hekaton: Sql server's memory-optimized oltp engine. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, pages 1243--1254. ACM, 2013.

Digital Library

[7]

J. Do, Y.-S. Kee, J. M. Patel, C. Park, K. Park, and D.J. DeWitt. Query processing on smart ssds: opportunities and challenges. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, pages 1221--1230. ACM, 2013.

Digital Library

[8]

J. Do and J. M. Patel. Join processing for flash ssds: remembering past lessons. In Proceedings of the Fifth International Workshop on Data Management on New Hardware, pages 1--8. ACM, 2009.

Digital Library

[9]

J. Do, S. Sengupta, and S. Swanson Programmable Solid-State Storage in Future Cloud Datacenters. Communications of the ACM, 2019.

[10]

J. González and M. Bjørling. Multi-tenant i/o isolation with open-channel ssds. In Nonvolatile Memory Workshop (NVMW), 2017.

[11]

Jim Gray, Gianfranco R. Putzolu: The 5 Minute Rule for Trading Memory for Disk Accesses and The 10 Byte Rule for Trading Memory for CPU Time. SIGMOD Conference 1987: 395--398

Digital Library

[12]

B. Gu, A. S. Yoon, D.-H. Bae, I. Jo, J. Lee, J. Yoon, J.-U. Kang, M. Kwon, C. Yoon, S. Cho, et al. Biscuit: A framework for near-data processing of big data workloads. In ACM SIGARCH Computer Architecture News, volume 44, pages 153--165. IEEE Press, 2016.

[13]

M. Hao, G. Soundararajan, D. R. Kenchammana-Hosekote, A. A. Chien, and H. S. Gunawi. The tail at store: A revelation from millions of hours of disk and ssd deployments. In FAST, pages 263--276, 2016.

Digital Library

[14]

J. Huang, A. Badam, L. Caulfield, S. Nath, S. Sengupta, B. Sharma, and M. K. Qureshi. Flashblox: Achieving both performance isolation and uniform lifetime for virtualized ssds. In FAST, pages 375--390, 2017.

Digital Library

[15]

Y. Jin, H.-W. Tseng, Y. Papakonstantinou, and S. Swanson. Kaml: A flexible, high-performance key-value ssd. In High Performance Computer Architecture (HPCA), 2017 IEEE International Symposium on, pages 373--384. IEEE, 2017.

[16]

I. Jo, D.-H. Bae, A. S. Yoon, J.-U. Kang, S. Cho, D. D. Lee, and J. Jeong. Yoursql: a high-performance database system leveraging in-storage computing. Proceedings of the VLDB Endowment, 9(12):924--935, 2016.

Digital Library

[17]

J. Kim, D. Lee, and S. H. Noh. Towards slo complying ssds through ops isolation. In FAST, pages 183--189, 2015.

Digital Library

[18]

G. Koo, K. K. Matam, H. Narra, J. Li, H.-W. Tseng, S. Swanson, M. Annavaram, et al. Summarizer: trading communication with computing near storage. In Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture, pages 219--231. ACM, 2017.

Digital Library

[19]

J. Lee, M. Muehle, N. May, F. Faerber, V. Sikka, H. Plattner, J. Krueger, and M. Grund. High-performance transaction processing in sap hana. IEEE Data Eng. Bull., 36(2):28--33, 2013.

[20]

C. Lee, D. Sim, J. Y. Hwang, and S. Cho. F2fs: A new file system for flash storage. In FAST, pages 273--286, 2015.

Digital Library

[21]

J. Levandoski, D. Lomet, and S. Sengupta. Llama: A cache/storage subsystem for modern hardware. Proceedings of the VLDB Endowment, 6(10):877--888, 2013.

Digital Library

[22]

J. Levandoski, D. Lomet, and S. Sengupta. The bw-tree: A b-tree for new hardware platforms. In Data Engineering (ICDE), 2013 IEEE 29th International Conference on, pages 302--313. IEEE, 2013.

Digital Library

[23]

J. Levandoski, D. Lomet, M. Mokbel, and K. Zhao. Deuteronomy: Transaction Support for Cloud Data. In CIDR, 2011.

[24]

D. Lomet. Cost/performance in modern data stores: how data caching systems succeed. In Proceedings of the 14th International Workshop on Data Management on New Hardware, page 9. ACM, 2018.

[25]

Y. Lu, J. Shu, W. Zheng, et al. Extending the lifetime of flash-based storage through reducing write amplification from file systems. In FAST, volume 13, 2013.

Digital Library

[26]

Microsoft Azure Cosmos DB. https://azure.microsoft.com/en-us/services/cosmos-db/

[27]

C. Mohan, D. Haderle, B. Lindsay, H. Pirahesh, and P. Schwarz. Aries: a transaction recovery method supporting fine-granularity locking and partial rollbacks using write-ahead logging. ACM Transactions on Database Systems (TODS), 17(1):94--162, 1992.

Digital Library

[28]

K. Park, Y.-S. Kee, J. M. Patel, J. Do, C. Park, and D. J. Dewitt. Query processing on smart ssds. IEEE Data Eng. Bull., 37(2):19--26, 2014.

[29]

I. L. Picoli, C. V. Pasco, B. Þ. Jónsson, L. Bouganim, and P. Bonnet. uflip-oc: Understanding flash i/o patterns on open-channel solid-state drives. In Proceedings of the 8th Asia-Pacific Workshop on Systems, page 20. ACM, 2017.

[30]

M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems (TOCS), 10(1):26--52, 1992.

[31]

ScaleFlux. Computational storage: Acceleration through intelligence & agility. Flash Memory Summit, 2018.

[32]

S. Seshadri, M. Gahagan, M. S. Bhaskaran, T. Bunker, A. De, Y. Jin, Y. Liu, and S. Swanson. Willow: A user-programmable ssd. In OSDI, pages 67--80, 2014.

Digital Library

[33]

M. Stonebraker and A. Weisberg. The voltdb main memory dbms. IEEE Data Eng. Bull., 36(2):21--27, 2013.

[34]

N. Systems. Intelligent storage produces efficient scalable system. Flash Memory Summit, 2018.

[35]

K. Vaid. Microsoft creates industry standards for datacenter hardware storage and security. https://azure.microsoft.com/en-us/blog/microsoft-creates-industry-standards-for-datacenter-hardware-storage-and-security/, 2018.

[36]

P. Wang, G. Sun, S. Jiang, J. Ouyang, S. Lin, C. Zhang, and J. Cong. An efficient design and implementation of lsm-tree based key-value store on open-channel ssd. In Proceedings of the Ninth European Conference on Computer Systems, page 16. ACM, 2014.

Digital Library

[37]

J. Xu and S. Swanson. Nova: A log-structured file system for hybrid volatile/non-volatile main memories. In FAST, pages 323--338, 2016.

Digital Library

[38]

J. Zhang, Y. Lu, J. Shu, and X. Qin. Flashkv: Accelerating kv performance with open-channel ssds. ACM Transactions on Embedded Computing Systems (TECS), 16(5s):139, 2017.

Digital Library

Cited By

Wang RYang XLi FLomet DLiu XZhou PChen YZhang DZhou JWu J(2024) Bw e -tree: An Evolution of Bw-tree on Fast Storage 2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00396(5266-5279)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00396
Vinçon TKnödler CSolis-Vasquez LBernhardt ATamimi SWeber LStock FKoch APetrov I(2022)Near-data processing in database systems on native computational storage under HTAP workloadsProceedings of the VLDB Endowment10.14778/3547305.354730715:10(1991-2004)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.14778/3547305.3547307
Roy TGupta JKant KPal AMinturn D(2021) PLM light : Emulating Predictable Latency Mode in Regular SSDs 2021 IEEE 20th International Symposium on Network Computing and Applications (NCA)10.1109/NCA53618.2021.9685772(1-8)Online publication date: 23-Nov-2021
https://doi.org/10.1109/NCA53618.2021.9685772
Show More Cited By

Recommendations

Improving SSD lifetime with byte-addressable metadata
MEMSYS '17: Proceedings of the International Symposium on Memory Systems

Existing solid state drives (SSDs) provide flash-based out-of-band (OOB) data that can only be updated on a page write. Consequently, the metadata stored in their OOB region lack flexibility due to the idiosyncrasies of flash memory, incurring ...
An Embedded FTL for SSD RAID
DSD '15: Proceedings of the 2015 Euromicro Conference on Digital System Design

Solid State Disk (SSD) storage systems are the storage medium of choice in modern embedded devices, and so the performance, lifespan, and reliability of these devices is an increasing issue in many application domains. Previous work has proposed ...
Key-value FTL over open channel SSD
SYSTOR '19: Proceedings of the 12th ACM International Conference on Systems and Storage

The wide adoption of key-value (KV) data structures (such as in Apache Cassandra[1], Redis[2], RocksDB[3]) along with the ongoing efforts to support KV commands in the NVMe standard, motivates the development of KV at the drive level. The abstract ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DaMoN'19: Proceedings of the 15th International Workshop on Data Management on New Hardware

July 2019

150 pages

ISBN:9781450368018

DOI:10.1145/3329785

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

SIGMOD/PODS '19

Sponsor:

SIGMOD

SIGMOD/PODS '19: International Conference on Management of Data

July 1, 2019

Amsterdam, Netherlands

Acceptance Rates

Overall Acceptance Rate 49 of 72 submissions, 68%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
554
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)8

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang RYang XLi FLomet DLiu XZhou PChen YZhang DZhou JWu J(2024) Bw e -tree: An Evolution of Bw-tree on Fast Storage 2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00396(5266-5279)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00396
Vinçon TKnödler CSolis-Vasquez LBernhardt ATamimi SWeber LStock FKoch APetrov I(2022)Near-data processing in database systems on native computational storage under HTAP workloadsProceedings of the VLDB Endowment10.14778/3547305.354730715:10(1991-2004)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.14778/3547305.3547307
Roy TGupta JKant KPal AMinturn D(2021) PLM light : Emulating Predictable Latency Mode in Regular SSDs 2021 IEEE 20th International Symposium on Network Computing and Applications (NCA)10.1109/NCA53618.2021.9685772(1-8)Online publication date: 23-Nov-2021
https://doi.org/10.1109/NCA53618.2021.9685772
Do JLuo CLomet D(2021)Programming an SSD Controller to Support Batched Writes for Variable-Size Pages2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00071(756-767)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00071
Do JPicoli ILomet DBonnet P(2021)Better database cost/performance via batched I/O on programmable SSDThe VLDB Journal10.1007/s00778-020-00648-zOnline publication date: 18-Feb-2021
https://doi.org/10.1007/s00778-020-00648-z
Yoon JJeong WRo W(2020)Check-In: In-Storage Checkpointing for Key-Value Store System Leveraging Flash-Based SSDs2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA45697.2020.00063(693-706)Online publication date: May-2020
https://doi.org/10.1109/ISCA45697.2020.00063

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents