More Web Proxy on the site http://driver.im/

research-article

Improving I/O performance of NVMe SSD on virtual machines

Authors:

Wooseok ChangAuthors Info & Claims

SAC '16: Proceedings of the 31st Annual ACM Symposium on Applied Computing

Pages 1852 - 1857

https://doi.org/10.1145/2851613.2851739

Published: 04 April 2016 Publication History

Abstract

The ever increasing demand of effective resource utilization in data centers has resulted in the dramatic development of various virtualization environments. Furthermore, the requirements on rapid processing of large data has not only caused to the replacement of spinning disks with flash-based SSD but also has led to the implementation of efficient software I/O stacks for SSDs. The software I/O stacks in most hypervisors have been developed for SATA interface-based storages. Therefore, high throughput and various functionalities provided by the NVMebased SSDs cannot be fully utilized. Also, it was found that the inefficiency of the existing storage I/O is due to the nonoptimized I/O stack of virtual machines in a hypervisor. In this paper, we have proposed a new I/O architecture that optimizes the I/O path by eliminating the overhead of user-level threads, bypassing unnecessary I/O routines and enhancing the interrupt delivery delay. The purpose of the proposed architecture is to enhance the throughput and scalability by mitigating the overhead of the existing software stack to take full advantage of NVMe SSDs. Experimental results with a real system show that the proposed approach improves the I/O performance by up to 47% compared to the existing approach.

References

[1]

VMware homepage. 2015. http://www.vmware.com

[2]

Kivity, A., Kamay, Y., Laor, D., Lublin, U., and Liguori, A. KVM: the Linux virtual machine monitor. In Proceedings of the Linux Symposium (Ottawa, Ontario, Canada, June 2007). 225--230.

[3]

Xen Project Software Overview. 2015. http://wiki.xen.org/wiki/Xen_Overview.

[4]

Dong, Y., Yu, Z., and Rose, G. SR-IOV Networking in Xen: Architecture, Design and Implementation. In Workshop on I/O Virtualization (WIOV '08) (San Diego, CA., Dec. 10-11, 2008).

Digital Library

[5]

AMD I/O virtualization technology (IOMMU) specification. 2011. http://developer.amd.com/wordpress/media/2012/10/488821.pdf

[6]

Russell, R. virtio: towards a de-facto standard for virtual I/O devices. ACM SIGOPS Operating Systems Review, 42, 5 (July 2008), 95--103.

Digital Library

[7]

NVM Express specification. 2015. http://www.nvmexpress.org/specifications/

[8]

Bjørling, M., Axboe, J., Nellans, D., and Bonnet, P. Linux block IO: introducing multi-queue SSD access on multi-core systems. In Proceedings of the 6th International Systems and Storage Conference (SYSTOR '13) (Haifa, Israel, June 30-July 2). ACM Press, New York, NY, 2013.

Digital Library

[9]

Huynh, K. Exploiting the latest KVM features for optimized virtualized enterprise storage performance. In CloudOpen, North America (2013).

[10]

Lei, M., Virtio-blk Multi-queue Conversion and QEMU Optimization. In KVM Forum (Düsseldorf, Germany, Oct. 14-16, 2014). http://events.linuxfoundation.org/sites/events/files/slides/virti o-blk_qemu_v0.96.pdf

[11]

Kim, T. Y., Kang, D. H., Lee, D. W., and Eom, Y. I. Improving performance by bridging the semantic gap between multi-queue SSD and I/O virtualization framework. In Proceedings of 31st Symposium on Mass Storage Systems and Technologies (MSST '15) (Santa Clara, CA, May 30-June 5, 2015), IEEE, 2015, 1--11.

[12]

Gordon, A., Har'El, N., Landau, A., Ben-Yehuda, M., and Traeger, A. Towards exitless and efficient paravirtual I/O. In Proceedings of the 5th Annual International Systems and Storage Conference (SYSTOR '12) (Haifa, Israel, June 4-6, 2012). ACM Press, New York, NY, 2012.

Digital Library

[13]

Oh, M., Eom, H., and Yeom, H. Y. Enhancing the I/O system for virtual machines using high performance SSDs. In Performance Computing and Communications Conference (IPCCC), 2014 IEEE International (Austin, TX, Dec. 5-7, 2014). IEEE, 1--8.

[14]

Cobb, D., and Huffman, A. Nvm express and the pci express ssd revolution. 2012. http://nvmexpress.org/wp-content/uploads/2013/04/IDF-2012-NVM-Express-and-the-PCIExpress-SSD-Revolution.pdf.

[15]

Bellard, F. QEMU, a Fast and Portable Dynamic Translator. In Proceedings of the annual conference on USENIX Annual Technical Conference (ATEC '05) (Anaheim, CA, April 10-15, 2005). USENIX Association, Berkeley, CA, USA, 2005.

Digital Library

[16]

Axboe, J. Flexible IO Tester. 2015. http://git.kernel.dk/?p=fio.git;a=summary

[17]

Kernel Asynchronous I/O. 2015. http://lse.sourceforge.net/io/aio.html

[18]

Nakajima, J. Enabling Optimized Interrupt/APIC Virtualization in KVM. In KVM Forum 2012 (Barcelona, Spain, November 7-9, 2012). http://www.linuxkvm.org/images/7/70/2012-forum-nakajima_apicv.pdf

Cited By

Ren ZDoekemeijer KTehrany NTrivedi ABalsamo SKnottenbelt WAbad CShang W(2024)BFQ, Multiqueue-Deadline, or Kyber? Performance Characterization of Linux Storage Schedulers in the NVMe EraProceedings of the 15th ACM/SPEC International Conference on Performance Engineering10.1145/3629526.3645053(154-165)Online publication date: 7-May-2024
https://dl.acm.org/doi/10.1145/3629526.3645053
Peng BYao JDong YGuan H(2022)MDev-NVMe: Mediated Pass-Through NVMe Virtualization Solution With Adaptive PollingIEEE Transactions on Computers10.1109/TC.2020.304578571:2(251-265)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1109/TC.2020.3045785
Peng BYang MYao JGuan H(2021)A Throughput-Oriented NVMe Storage Virtualization With Workload-Aware ManagementIEEE Transactions on Computers10.1109/TC.2020.303781770:12(2112-2124)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1109/TC.2020.3037817
Show More Cited By

Recommendations

Performance analysis of NVMe SSDs and their implication on real world databases
SYSTOR '15: Proceedings of the 8th ACM International Systems and Storage Conference

The storage subsystem has undergone tremendous innovation in order to keep up with the ever-increasing demand for throughput. Non Volatile Memory Express (NVMe) based solid state devices are the latest development in this domain, delivering ...
DirectNVM: Hardware-accelerated NVMe SSDs for High-performance Embedded Computing
With data-intensive artificial intelligence (AI) and machine learning (ML) applications rapidly surging, modern high-performance embedded systems, with heterogeneous computing resources, critically demand low-latency and high-bandwidth data communication. ...
Improving read performance by isolating multiple queues in NVMe SSDs
IMCOM '17: Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication

As NVMe SSDs have become viable, recent researches have focused on optimizing the performance of NVMe SSDs, which provide multiple I/O queues to maximize the I/O parallelism of flash-chip, while traditional operating systems are designed ordinarily for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '16: Proceedings of the 31st Annual ACM Symposium on Applied Computing

April 2016

2360 pages

ISBN:9781450337397

DOI:10.1145/2851613

Conference Chair:
Sascha Ossowski
University Rey Juan Carlos, Spain

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SAC 2016

Sponsor:

SIGAPP

SAC 2016: Symposium on Applied Computing

April 4 - 8, 2016

Pisa, Italy

Acceptance Rates

SAC '16 Paper Acceptance Rate 252 of 1,047 submissions, 24%;

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
795
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)2

Reflects downloads up to 04 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ren ZDoekemeijer KTehrany NTrivedi ABalsamo SKnottenbelt WAbad CShang W(2024)BFQ, Multiqueue-Deadline, or Kyber? Performance Characterization of Linux Storage Schedulers in the NVMe EraProceedings of the 15th ACM/SPEC International Conference on Performance Engineering10.1145/3629526.3645053(154-165)Online publication date: 7-May-2024
https://dl.acm.org/doi/10.1145/3629526.3645053
Peng BYao JDong YGuan H(2022)MDev-NVMe: Mediated Pass-Through NVMe Virtualization Solution With Adaptive PollingIEEE Transactions on Computers10.1109/TC.2020.304578571:2(251-265)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1109/TC.2020.3045785
Peng BYang MYao JGuan H(2021)A Throughput-Oriented NVMe Storage Virtualization With Workload-Aware ManagementIEEE Transactions on Computers10.1109/TC.2020.303781770:12(2112-2124)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1109/TC.2020.3037817
Xue SZhao SChen QDeng GLiu ZZhang JSong ZMa TYang YZhou YNiu KSun SGuo MGavrilovska AZadok E(2020)SpoolProceedings of the 2020 USENIX Conference on Usenix Annual Technical Conference10.5555/3489146.3489153(97-110)Online publication date: 15-Jul-2020
https://dl.acm.org/doi/10.5555/3489146.3489153
Kim SKim KShin HKim T(2020)Practical Enhancement of User Experience in NVMe SSDsApplied Sciences10.3390/app1014476510:14(4765)Online publication date: 10-Jul-2020
https://doi.org/10.3390/app10144765
Talebpour SAlinezhad S(2020)AAS: Address Aware Scheduler for Enhancing the Performance of NVMe SSDs in IoT Applications2020 10th International Conference on Computer and Knowledge Engineering (ICCKE)10.1109/ICCKE50421.2020.9303663(148-153)Online publication date: 29-Oct-2020
https://doi.org/10.1109/ICCKE50421.2020.9303663
Bona LElias AZiviani ANou RCortes TAlves M(2020)Freezing time emulating new and faster devices with virtual machinesCCF Transactions on High Performance Computing10.1007/s42514-020-00023-y2:1(3-15)Online publication date: 26-Feb-2020
https://doi.org/10.1007/s42514-020-00023-y
Li QWei DGao WXie X(2020)NV-BSP: A Burst I/O Storage Pool Based on NVMe SSDsAdvanced Computer Architecture10.1007/978-981-15-8135-9_13(178-191)Online publication date: 5-Sep-2020
https://doi.org/10.1007/978-981-15-8135-9_13
Pioli Lde Andrade Menezes VDantas M(2019)Research Characterization on I/O Improvements of Storage EnvironmentsAdvances on P2P, Parallel, Grid, Cloud and Internet Computing10.1007/978-3-030-33509-0_26(287-298)Online publication date: 20-Oct-2019
https://doi.org/10.1007/978-3-030-33509-0_26

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten