More Web Proxy on the site http://driver.im/

research-article

Turbocharging DBMS buffer pool using SSDs

Authors:

Jignesh M. Patel,

David J. DeWitt,

Jeffrey F. Naughton,

Alan HalversonAuthors Info & Claims

SIGMOD '11: Proceedings of the 2011 ACM SIGMOD International Conference on Management of data

Pages 1113 - 1124

https://doi.org/10.1145/1989323.1989442

Published: 12 June 2011 Publication History

Abstract

Flash solid-state drives (SSDs) are changing the I/O landscape, which has largely been dominated by traditional hard disk drives (HDDs) for the last 50 years. In this paper we propose and systematically explore designs for using an SSD to improve the performance of a DBMS buffer manager. We propose three alternatives that differ mainly in the way that they deal with the dirty pages evicted from the buffer pool. We implemented these alternatives, as well another recently proposed algorithm for this task (TAC), in SQL Server, and ran experiments using a variety of benchmarks (TPC-C, E and H) at multiple scale factors. Our empirical evaluation shows significant performance improvements of our methods over the default HDD configuration (up to 9.4X), and up to a 6.8X speedup over TAC.

References

[1]

D. Agrawal, D. Ganesan, R. K. Sitaraman, Y. Diao, and S. Singh. Lazy-Adaptive Tree: An Optimized Index Structure for Flash Devices. PVLDB, 2009.

Digital Library

[2]

R. Bitar. Deploying Hybrid Storage Pools with Sun Flash Technology and the Solaris ZFS File System. In Sun BluePrints Online, 2008.

[3]

B. Bhattacharjee, M. Canim, C. A. Lang, G. Mihaila, and K. A. Ross. Storage Class Memory Aware Data Management. In IEEE Data Engineering Bulletin, 33(4), 2010.

[4]

L. Bouganim, B. T. Jonsson, and P. Bonnet. uFLIP: Understanding Flash IO Patterns. In CIDR, 2009.

[5]

G. P. Copeland, W. Alexander, E. E. Boughter and T. W. Keller. Data Placement in Bubba. In SIGMOD, 1988.

Digital Library

[6]

M. Canim, B. Bhattacharjee, G. A. Mihaila, C. A. Lang, and K. A. Ross. An Object Placement Advisor for DB2 Using Solid State Storage. PVLDB, 2009.

Digital Library

[7]

M. Canim, G. A. Mihaila, B. Bhattacharjee, K. A. Ross, and C. A. Lang. SSD Bufferpool Extensions for Database Systems. In VLDB, 2010.

Digital Library

[8]

Computer World. HP offers SSDs in ProLiant server line, 2008. http://www.computerworld.com/s/article/9138209/HP_offers_SSDs_in_ProLiant_server_line

[9]

B. Dees. Native Command Queuing -- Advanced Performance in Desktop Storage. IEEE Potentials, 2007.

[10]

J. Do and J. M. Patel. Join Processing for Flash SSDs: Remembering Past Lessons. In DaMoN, 2009.

Digital Library

[11]

EE Times. SSDs: Still not a 'Solid State' Business, 2010. http://www.eetimes.com/electronics-news/4206361/SSDs--Still-not-a--solid-state--business

[12]

J. Gray. Tape is Dead, Disk is Tape, Flash is Disk, RAM Locality is King, 2006. http://research.microsoft.com/en-us/um/people/gray/talks/ Flash_is_Good.ppt

[13]

G. Graefe. The Five-Minute Rule Twenty Years Later, and How Flash Memory Changes the Rules. In DaMoN, 2007.

Digital Library

[14]

J. Gray and B. Fitzgerald. Flash Disk Opportunity for Server Applications. ACM Queue, 2008.

Digital Library

[15]

J. Gray and A. Reuter. Chapter 12: Advanced Transaction Manager Topics. In Transaction Processing: Concepts and Techniques, Morgan Kaufmann Publishers, 1993.

[16]

S. Hetzler. The Storage Chasm: Implications for the Future of HDD and Solid State Storage. IBM, 2009.

[17]

A. L. Holloway. Chapter 4: Extending the Buffer Pool with a Solid State Disk. In Adapting Database Storage for New Hardware, University of Wisconsin-Madison Ph.D. thesis, 2009.

Digital Library

[18]

Information Week. Google Plans to Use Intel SSD Storage in Servers, 2008. http://www.informationweek.com/news/storage/systems/showArticle.jhtml?articleID=207602745

[19]

Iometer. http://www.iometer.org

[20]

S.-H. Kim, D. Jung, J.-S. Kim, and S. Maeng. HeteroDrive: Re-shaping the Storage Access Pattern of OLTP workload using SSD. In IWSSPS, 2009.

[21]

I. Koltsidas and S. Viglas. Flashing Up the Storage Layer. PVLDB, 2008.

Digital Library

[22]

I. Koltsidas and S. Viglas. The Case for Flash-Aware Multi-Level Caching. Technical Report, University of Edinburgh, 2009. http://homepages.inf.ed.ac.uk/s0679010/mfcache-TR.pdf

[23]

S.-W. Lee and B. Moon. Design of Flash-Based DBMS: An In-Page Logging Approach. In SIGMOD, 2007.

Digital Library

[24]

S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A Case for Flash Memory SSD in Enterprise Database Applications. In SIGMOD, 2008.

Digital Library

[25]

S. T. Leutenegger and D. M. Dias. A Modeling Study of the TPC-C Benchmark. In SIGMOD, 1993.

Digital Library

[26]

C. Li, K. Shen, and A. E. Papathanasiou. Competitive Prefetching for Concurrent Sequential I/O. In EuroSys, 2007.

Digital Library

[27]

Y. Li, B. He, R. J. Yang, Q. Luo, and K. Yi. Tree Indexing on Solid State Drives. PVLDB, 2010.

Digital Library

[28]

Microsoft SQL Server 2008 R2 Editions. http://www.microsoft.com/sqlserver/2008/en/us/R2-editions.aspx

[29]

D. Narayanan, E. Thereska, A. Donnelly, S. Elnikety, and A. I. T. Rowstron. Migrating Server Storage to SSDs: Analysis of Tradeoffs. In EuroSys, 2009.

Digital Library

[30]

E. J. O'Neil, P. E. O'Neil, and G. Weikum. The LRU-K Page Replacement Algorithm for Database Disk Buffering. In SIGMOD, 1993.

Digital Library

[31]

Oracle Exadata. http://www.oracle.com/us/products/database/exadata.

[32]

M. Polte, J. Simsa, and G. Gibson. Enabling Enterprise Solid State Disks Performance. In WISH, 2009.

[33]

D. Tsirogiannis, S. Harizopoulos, M. A. Shah, J. L. Wiener, and G. Graefe. Query Processing Techniques for Solid State Drives. In SIGMOD, 2009.

Digital Library

[34]

Teradata. Virtual Storage. http://www.teradata.com/t/brochures/Teradata-Virtual-Storage-eb5944.

[35]

TPC Benchmark C (TPC-C). http://www.tpc.org/tpcc.

[36]

TPC Benchmark E (TPC-E). http://www.tpc.org/tpce.

[37]

TPC Benchmark H (TPC-H). http://www.tpc.org/tpch.

[38]

C.-H. Wu, T.-W. Kuo, and L.-P. Chang. An Efficient B-tree Layer Implementation for Flash-Memory Storage Systems. ACM TECS, 2007

Digital Library

Cited By

Kuschewski MGiceva JNeumann TLeis V(2024)High-Performance Query Processing with NVMe Arrays: Spilling without Killing PerformanceProceedings of the ACM on Management of Data10.1145/36988132:6(1-27)Online publication date: 20-Dec-2024
https://dl.acm.org/doi/10.1145/3698813
Kim CSon YKim S(2024)Investigating the effects of SQL hints on diverse storage devices through empirical analysisCluster Computing10.1007/s10586-024-04853-128:2Online publication date: 26-Nov-2024
https://doi.org/10.1007/s10586-024-04853-1
Papon TAthanassoulis M(2023)ACEing the Bufferpool Management Paradigm for Modern Storage Devices2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00106(1326-1339)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00106
Show More Cited By

Index Terms

Turbocharging DBMS buffer pool using SSDs
1. Information systems
  1. Data management systems
    1. Database design and models
      1. Relational database model
    2. Query languages
      1. Relational database query languages

Recommendations

Disk Read-Write Optimizations and Data Integrity in Transaction Systems Using Write-Ahead Logging
ICDE '95: Proceedings of the Eleventh International Conference on Data Engineering

We discuss several disk read-write optimizations that are implemented in different transaction systems and disk hardware to improve performance. These include: (1) when multiple sectors are written to disk, the sectors may be written out of sequence (...
An empirical evaluation and analysis of the performance of NVM express solid state drive

Emerging non-volatile memory (NVM) technology with high throughput and scalability has considerable attraction in cloud and enterprise storage systems. The industry and academic communities made the NVMe specification to elicit the highest performance ...
An adaptive write buffer management scheme for flash-based SSDs

Solid State Drives (SSD's) have shown promise to be a candidate to replace traditional hard disk drives. The benefits of SSD's over HDD's include better durability, higher performance, and lower power consumption, but due to certain physical ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '11: Proceedings of the 2011 ACM SIGMOD International Conference on Management of data

June 2011

1364 pages

ISBN:9781450306614

DOI:10.1145/1989323

General Chair:
Timos Sellis
IMIS/RC Athena
,
Program Chair:
Renée J. Miller
University of Toronto
,
Publications Chairs:
Anastasios Kementsietsidis
IBM T.J. Watson Research Center
,
Yannis Velegrakis
University of Trento

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGMOD/PODS '11

Sponsor:

SIGMOD

SIGMOD/PODS '11: International Conference on Management of Data

June 12 - 16, 2011

Athens, Greece

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

62
Total Citations
View Citations
864
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kuschewski MGiceva JNeumann TLeis V(2024)High-Performance Query Processing with NVMe Arrays: Spilling without Killing PerformanceProceedings of the ACM on Management of Data10.1145/36988132:6(1-27)Online publication date: 20-Dec-2024
https://dl.acm.org/doi/10.1145/3698813
Kim CSon YKim S(2024)Investigating the effects of SQL hints on diverse storage devices through empirical analysisCluster Computing10.1007/s10586-024-04853-128:2Online publication date: 26-Nov-2024
https://doi.org/10.1007/s10586-024-04853-1
Papon TAthanassoulis M(2023)ACEing the Bufferpool Management Paradigm for Modern Storage Devices2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00106(1326-1339)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00106
Guo BYu JYang DLeng HLiao B(2022)Energy-Efficient Database Systems: A Systematic SurveyACM Computing Surveys10.1145/353822555:6(1-53)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1145/3538225
Menon PQadah TRabl TSadoghi MJacobsen H(2022)LogStore: A Workload-Aware, Adaptable Key-Value Store on Hybrid Storage SystemsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2020.302719134:8(3867-3882)Online publication date: 1-Aug-2022
https://doi.org/10.1109/TKDE.2020.3027191
Shedge SSharma NAgarwal AAbouzour MAluc G(2022)An Extended SSD-Based Cache for Efficient Object Store Access in SAP IQ2022 IEEE 38th International Conference on Data Engineering (ICDE)10.1109/ICDE53745.2022.00185(1861-1873)Online publication date: May-2022
https://doi.org/10.1109/ICDE53745.2022.00185
Cadenelli NJun SPolo JWright ACarrera DArvind (2021)Enabling Genomics Pipelines in Commodity Personal Computers With Flash StorageFrontiers in Genetics10.3389/fgene.2021.61595812Online publication date: 29-Apr-2021
https://doi.org/10.3389/fgene.2021.615958
Yang JLi BLilja DWassermann BMalka MChidambaram VRaz D(2021)HeuristicDBProceedings of the 14th ACM International Conference on Systems and Storage10.1145/3456727.3463774(1-12)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1145/3456727.3463774
Ren JChen XLiu DTan YDuan MLi RLiang L(2021)A machine learning assisted data placement mechanism for hybrid storage systemsJournal of Systems Architecture: the EUROMICRO Journal10.1016/j.sysarc.2021.102295120:COnline publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1016/j.sysarc.2021.102295
Zhang YZhou KHuang PWang HHu JWang YJi YCheng B(2020)A Machine Learning Based Write Policy for SSD Cache in Cloud Block Storage2020 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE48585.2020.9116539(1279-1282)Online publication date: Mar-2020
https://doi.org/10.23919/DATE48585.2020.9116539
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents