More Web Proxy on the site http://driver.im/

research-article

The effects of virtualization on main memory systems

Authors:

Alexander ZeierAuthors Info & Claims

DaMoN '10: Proceedings of the Sixth International Workshop on Data Management on New Hardware

Pages 41 - 46

https://doi.org/10.1145/1869389.1869395

Published: 07 June 2010 Publication History

Abstract

Virtualization is mainly employed for increasing the utilization of a lightly-loaded system by consolidation, but also to ease the administration based on the possibility to rapidly provision or migrate virtual machines. These facilities are crucial for efficiently managing large data centers. At the same time, modern hardware --- such as Intel's Nehalem microarchitecure --- change critical assumptions about performance bottlenecks and software systems explicitly exploiting the underlying hardware --- such as main memory databases --- gain increasing momentum.

In this paper, we address the question of how these specialized software systems perform in a virtualized environment. To do so, we present a set of experiments looking at several different variants of in-memory databases: The MonetDB Calibrator, a fine-grained hybrid row/column in-memory database running an OLTP workload, and an in-memory column store database running a multi-user OLAP workload.

We examine how memory management in virtual machine monitors affects these three classes of applications. For the multi-user OLAP experiment we also experimentally compare a virtualized Nehalem server to one of its predecessors. We show that saturation of the memory bus is a major limiting factor but is much less impactful on the new architecture.

References

[1]

}}K. Adams and O. Agesen. A comparison of software and hardware techniques for x86 virtualization. In J. P. Shen and M. Martonosi, editors, ASPLOS, pages 2--13. ACM, 2006.

Digital Library

[2]

}}P. Barham, B. Dragovic, K. Fraser, S. Hand, T. L. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In M. L. Scott and L. L. Peterson, editors, SOSP, pages 164--177. ACM, 2003.

Digital Library

[3]

}}D. Jacobs and S. Aulbach. Ruminations on multi-tenant databases. In A. Kemper, H. Schöning, T. Rose, M. Jarke, T. Seidl, C. Quix, and C. Brochhaus, editors, BTW, volume 103 of LNI, pages 514--521. GI, 2007.

[4]

}}B. Jaecksch, W. Lehner, and F. Faerber. A plan for olap. In I. Manolescu, S. Spaccapietra, J. Teubner, M. Kitsuregawa, A. Léger, F. Naumann, A. Ailamaki, and F. Özcan, editors, EDBT, volume 426 of ACM International Conference Proceeding Series, pages 681--686. ACM, 2010.

[5]

}}S. Manegold, P. A. Boncz, and M. L. Kersten. Generic database cost models for hierarchical memory systems. In VLDB, pages 191--202. Morgan Kaufmann, 2002.

Digital Library

[6]

}}A. Menon, J. R. Santos, Y. Turner, G. J. Janakiraman, and W. Zwaenepoel. Diagnosing performance overheads in the xen virtual machine environment. In M. Hind and J. Vitek, editors, VEE, pages 13--23. ACM, 2005.

Digital Library

[7]

}}D. Molka, D. Hackenberg, R. Schöne, and M. S. Müller. Memory performance and cache coherency effects on an intel nehalem multiprocessor system. In PACT, pages 261--270. IEEE Computer Society, 2009.

Digital Library

[8]

}}P. E. O'Neil, E. J. O'Neil, X. Chen, and S. Revilak. The star schema benchmark and augmented fact table indexing. In R. O. Nambiar and M. Poess, editors, TPCTC, volume 5895 of Lecture Notes in Computer Science, pages 237--252. Springer, 2009.

Digital Library

[9]

}}H. Plattner. A common database approach for oltp and olap using an in-memory column database. In U. Çetintemel, S. B. Zdonik, D. Kossmann, and N. Tatbul, editors, SIGMOD Conference, pages 1--2. ACM, 2009.

Digital Library

[10]

}}J. Schaffner, A. Bog, J. Krüger, and A. Zeier. A hybrid row-column oltp database architecture for operational reporting. In BIRTE (Informal Proceedings), 2008.

[11]

}}J. Schaffner, D. Jacobs, B. Eckart, J. Brunnert, and A. Zeier. Towards enterprise software as a service in the cloud. In Proceedings of the 2nd IEEE Workshop on Information and Software as Services (WISS), 2010.

[12]

}}M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. J. O'Neil, P. E. O'Neil, A. Rasin, N. Tran, and S. B. Zdonik. C-store: A column-oriented dbms. In K. Böhm, C. S. Jensen, L. M. Haas, M. L. Kersten, P.-Å. Larson, and B. C. Ooi, editors, VLDB, pages 553--564. ACM, 2005.

Digital Library

[13]

}}D. Terpstra, H. Jagode, Y. Haihang, and J. Dongarra. Collecting performance data with papi-c. Proceedings of 3rd Parallel Tools Workshop, Sep 2009.

[14]

}}M. Zukowski, S. Heman, N. Nes, and P. Boncz. Super-scalar ram-cpu cache compression. In ICDE '06, page 59, Washington, DC, USA, 2006. IEEE Computer Society.

Digital Library

[15]

}}M. Zukowski, S. Héman, N. Nes, and P. A. Boncz. Super-scalar ram-cpu cache compression. In L. Liu, A. Reuter, K.-Y. Whang, and J. Zhang, editors, ICDE, page 59. IEEE Computer Society, 2006.

Digital Library

Cited By

Kohler JSpecht T(2021)Towards a Secure, Distributed, and Reliable Cloud-Based Reference Architecture for Big Data in Smart CitiesResearch Anthology on Architectures, Frameworks, and Integration Strategies for Distributed and Cloud Computing10.4018/978-1-7998-5339-8.ch006(123-149)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-5339-8.ch006
Kohler JSpecht T(2019)Towards a Secure, Distributed, and Reliable Cloud-Based Reference Architecture for Big Data in Smart CitiesBig Data Analytics for Smart and Connected Cities10.4018/978-1-5225-6207-8.ch003(38-70)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-6207-8.ch003
Mühlbauer TRödiger WKipf AKemper ANeumann T(2015)High-Performance Main-Memory Database Systems and Modern VirtualizationProceedings of the Fourth Workshop on Data analytics in the Cloud10.1145/2799562.2799643(1-4)Online publication date: 31-May-2015
https://dl.acm.org/doi/10.1145/2799562.2799643
Show More Cited By

Index Terms

The effects of virtualization on main memory systems

Recommendations

High-Performance Main-Memory Database Systems and Modern Virtualization: Friends or Foes?
DanaC'15: Proceedings of the Fourth Workshop on Data analytics in the Cloud

Virtualization owes its popularity mainly to its ability to consolidate software systems from many servers into a single server without sacrificing the desirable isolation between applications. This not only reduces the total cost of ownership, but also ...
Improving machine virtualisation with 'hotplug memory'

Machine virtualisation is a key technology for server consolidation and on-demand server provisioning. To support this trend, it is essential to improve the performance of virtualisation software and enable the efficient running of many virtual ...
Selective hardware/software memory virtualization
VEE '11

As virtualization becomes a key technique for supporting cloud computing, much effort has been made to reduce virtualization overhead, so a virtualized system can match its native performance. One major overhead is due to memory or page table ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DaMoN '10: Proceedings of the Sixth International Workshop on Data Management on New Hardware

June 2010

56 pages

ISBN:9781450301893

DOI:10.1145/1869389

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SIGMOD/PODS '10

Sponsor:

SIGMOD

SIGMOD/PODS '10: International Conference on Management of Data

June 7, 2010

Indiana, Indianapolis

Acceptance Rates

Overall Acceptance Rate 94 of 127 submissions, 74%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
378
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kohler JSpecht T(2021)Towards a Secure, Distributed, and Reliable Cloud-Based Reference Architecture for Big Data in Smart CitiesResearch Anthology on Architectures, Frameworks, and Integration Strategies for Distributed and Cloud Computing10.4018/978-1-7998-5339-8.ch006(123-149)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-5339-8.ch006
Kohler JSpecht T(2019)Towards a Secure, Distributed, and Reliable Cloud-Based Reference Architecture for Big Data in Smart CitiesBig Data Analytics for Smart and Connected Cities10.4018/978-1-5225-6207-8.ch003(38-70)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-6207-8.ch003
Mühlbauer TRödiger WKipf AKemper ANeumann T(2015)High-Performance Main-Memory Database Systems and Modern VirtualizationProceedings of the Fourth Workshop on Data analytics in the Cloud10.1145/2799562.2799643(1-4)Online publication date: 31-May-2015
https://dl.acm.org/doi/10.1145/2799562.2799643
Meyer RBanova VDanciu APrutscher DKrcmar H(2015)Assessing the Suitability of In-Memory Databases in an Enterprise ContextProceedings of the 2015 International Conference on Enterprise Systems10.1109/ES.2015.15(78-89)Online publication date: 14-Oct-2015
https://dl.acm.org/doi/10.1109/ES.2015.15
Ding XShan J(2015)Diagnosing Virtualization Overhead for Multi-threaded Computation on Multicore PlatformsProceedings of the 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom)10.1109/CloudCom.2015.102(226-233)Online publication date: 30-Nov-2015
https://dl.acm.org/doi/10.1109/CloudCom.2015.102
Schaffner JSchaffner J(2013)A Model for Load Management and Response Time PredictionMulti Tenancy for Cloud-Based In-Memory Column Databases10.1007/978-3-319-00497-6_3(19-39)Online publication date: 3-Jun-2013
https://doi.org/10.1007/978-3-319-00497-6_3
Guan Q(2013)A Method of Deploying Virtual Machine on Multi-core CPU in Decomposed WayEmerging Technologies for Information Systems, Computing, and Management10.1007/978-1-4614-7010-6_94(845-852)Online publication date: 2013
https://doi.org/10.1007/978-1-4614-7010-6_94
Guan QYe LXu D(2011)Deployment of Virtual Machine on X86 Platform Based in Decomposed Way2011 International Conference on Internet Technology and Applications10.1109/ITAP.2011.6006168(1-4)Online publication date: Aug-2011
https://doi.org/10.1109/ITAP.2011.6006168
Chen HJiang LDong WWang L(2011)An Emulation Model of IA-32 Memory ManagementProceedings of the 2011 International Conference on Intelligence Science and Information Engineering10.1109/ISIE.2011.41(321-324)Online publication date: 20-Aug-2011
https://dl.acm.org/doi/10.1109/ISIE.2011.41
Schapranow MMüller JZeier APlattner H(2011)Costs of authentic pharmaceuticals: research on qualitative and quantitative aspects of enabling anti-counterfeiting in RFID-aided supply chainsPersonal and Ubiquitous Computing10.1007/s00779-011-0390-416:3(271-289)Online publication date: 4-Jun-2011
https://doi.org/10.1007/s00779-011-0390-4

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents