More Web Proxy on the site http://driver.im/

Article

Design of flash-based DBMS: an in-page logging approach

Authors:

Bongki MoonAuthors Info & Claims

SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data

Pages 55 - 66

https://doi.org/10.1145/1247480.1247488

Published: 11 June 2007 Publication History

Abstract

The popularity of high-density flash memory as data storage media has increased steadily for a wide spectrum of computing devices such as PDA's, MP3 players, mobile phones and digital cameras. More recently, computer manufacturers started launching new lines of mobile or portable computers that did away with magnetic disk drives altogether, replacing them with tens of gigabytes of NAND flash memory. Like EEPROM and magnetic disk drives, flash memory is non-volatile and retains its contents even when the power is turned off. As its capacity increases and price drops, flash memory will compete more successfully with lower-end, lower-capacity disk drives. It is thus not inconceivable to consider running a full database system on the flash-only computing platforms or running an embedded database system on the lightweight computing devices. In this paper, we present a new design called in-page logging (IPL) for flash memory based database servers. This new design overcomes the limitations of flash memory such as high write latency, and exploits unique characteristics of flash memory to achieve the best attainable performance for flash-based database servers. We show empirically that the IPL approach can yield considerable performance benefit over traditional design for disk-based database servers. We also show that the basic design of IPL can be elegantly extended to support transactional database recovery.

References

[1]

Brad Adelberg, Ben Kao, and Hector Garcia-Molina. Database Support for Efficiently Maintaining Derived Data. In the 5th International Conference on Extending Database Technology, pages 223--240, Avignon, France, March 1996.

Digital Library

[2]

Andrew Birrel, Michael Isard, Chuck Thacker, and Ted Wobber. A Design for High-Performance Flash Disks. Technical Report MSR-TR-2005-176, Microsoft Research, December 2005.

[3]

Christophe Bobineau, Luc Bouganim, Philippe Pucheral, and Patrick Valduriez. PicoDBMS: Scaling Down Database Techniques for the Smartcard. In Proceedings of the 26th VLDB Conference, pages 11--20, Cairo, Egypt, September 2000.

Digital Library

[4]

R. Bonilla-Lucas et al. Characterization of the Data Access Behavior for TPC-C Traces. In Performance Analysis of Systems and Software, pages 115--122, 2004.

Digital Library

[5]

Hui Dai, Michael Neufeld, and Richard Han. ELF: An Efficient Log-Structured Flash File System for Micro Sensor Nodes. In The Second International Conference on Embedded Networked Sensor Systems (SenSys'03), pages 176--187, Baltimore, MD, USA, November 2004.

Digital Library

[6]

Fred Douglis, Ramon Caceres, Frans Kaashoek, Kai Li, Brian Marsh, and Joshua A. Tauber. Storage Alternatives for Mobile Computers. In Proceedings of the USENIX 1st Symposium on Operating Systems Design and Implementation (OSDI--94), Monterey, CA, USA, November 1994.

[7]

Julian Dyke and Steve Shaw. Pro Oracle Database 10g RAC on Linux: Installation, Administration, and Performance. Apress, 2006.

Digital Library

[8]

Eran Gal and Sivan Toledo. Algorithms and Data Structures for Flash Memories. ACM Computing Surveys, 37(2):138--163, June 2005.

Digital Library

[9]

Goetz Graefe. Write-Optimized B-Trees. In Proceedings of the 30th VLDB Conference, pages 672--683, Toronto, Canada, September 2004.

Digital Library

[10]

Jim Gray and Andreas Reuter. Transaction Processing: Concepts and Techniques. Morgan Kaufmann, 1993.

Digital Library

[11]

MTRON Media Experts Group. MSD-P Series Production Specification. Technical Report Version 0.7 sv, MTRON Co. Ltd., October 2006.

[12]

Mark Hachman.New Samsung Notebook Replaces Hard Drive With Flash. http://www.extremetech. com, May 2006.

[13]

Theo Härder and Andreas Reuter. Principles of Transaction-Oriented Database Recovery. ACM Computing Survey, 15(4):287--317, 1983.

Digital Library

[14]

Windsor W. Hsu, Alan Jay Smith, and Honesty C. Young. I/O Reference Behavior of Production Database Workloads and the TPC Benchmarks-An Analysis at the Logical Level. ACM Transactions on Database System, 26(1):96--143, 2001.

Digital Library

[15]

Atsushi Inoue and Doug Wong. NAND Flash Applications Design Guide. Technical Report Revision 2.0, Toshiba America Electronic Components, Inc., March 2004.

[16]

Intel. Understanding the Flash Translation Layer (FTL) Specification. Application Note AP-684, Intel Corporation, December 1998.

[17]

Gye-Jeong Kim, Seung-Cheon Baek, Hyun-Sook Lee, Han-Deok Lee, and Moon Jeung Joe. LGeDBMS: A Small DBMS for Embedded System with Flash Memory. In Proceedings of the 32nd International Conference on Very Large Data Bases, Seoul, Korea, September 12-15, 2006, pages 1255--1258. ACM, 2006.

Digital Library

[18]

Jesung Kim, Jong Min Kim, Sam H. Noh, Sang Lyul Min, and Yookun Cho. A Space-Efficient Flash Translation Layer for CompactFlash Systems. IEEE Transactions on Consumer Electronics, 48(2):366--375, May 2002.

Digital Library

[19]

Katsutaka Kimura and Takashi Kobayashi. Trends in High-Density Flash Memory Technologies. In IEEE Conference on Electron Devices and Solid-State Circuits, pages 45--50, Hong Kong, December 2003.

[20]

C. Mohan, Donald J. Haderle, Bruce G. Lindsay, Hamid Pirahesh, and Peter M. Schwarz. ARIES: A Transaction Recovery Method Supporting Fine-Granularity Locking and Partial Rollbacks Using Write-Ahead Logging. ACM Transactions on Database Systems, 17(1):94--162, 1992.

Digital Library

[21]

Linda Dailey Paulson. Will Hard Drives Finally Stop Shrinking? IEEE Computer, 38(5):14--16, May 2005.

Digital Library

[22]

Mendel Rosenblum.The Design and Implementation of a Log--Structured File System.PhD thesis, UC Berkeley, 1991.

[23]

Mendel RosenBlum and John K. Ousterhout. The Design and Implementation of a Log-Structured File System. In the 13th Symposium on Operating System Principles, pages 1--15, Pacific Grove, CA, September 1991.

Digital Library

[24]

Rajkumar Sen and Krithi Ramamritham. Efficient Data Management on Lightweight Computing Devices. In Proceedings of the 21st Inter. Conference on Data Engineering, Tokyo, Japan, April 2005.

Digital Library

[25]

Michael Stonebraker. The Design of the Postgres Storage System. In Proceedings of 13th International Conference on Very Large Data Bases, September 1-4, 1987, Brighton, England, pages 289--300. Morgan Kaufmann, 1987.

Digital Library

[26]

Michael Stonebraker and Greg Kemnitz. The Postgres Next Generation Database Management System. Communications of the ACM, 34(10):78--92, Oct 1991.

Digital Library

Cited By

Kim CSon YKim S(2024)Investigating the effects of SQL hints on diverse storage devices through empirical analysisCluster Computing10.1007/s10586-024-04853-128:2Online publication date: 26-Nov-2024
https://doi.org/10.1007/s10586-024-04853-1
Nguyen LLee SNam B(2022)In-page shadowing and two-version timestamp ordering for mobile DBMSsProceedings of the VLDB Endowment10.14778/3551793.355180215:11(2402-2414)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.14778/3551793.3551802
Han JSon Y(2022)An Efficient Block Address Transformation Scheme in Block Layer for Flash-Based SSDsIEEE Access10.1109/ACCESS.2022.314685210(14236-14245)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3146852
Show More Cited By

Index Terms

Design of flash-based DBMS: an in-page logging approach
1. Information systems
  1. Data management systems
    1. Database design and models
      1. Physical data models

Recommendations

A case for flash memory ssd in enterprise database applications
SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

Due to its superiority such as low access latency, low energy consumption, light weight, and shock resistance, the success of flash memory as a storage alternative for mobile computing devices has been steadily expanded into personal computer and ...
Design and implementation of MLC NAND flash-based DBMS for mobile devices

Recently, Multi-Level Cell (MLC) NAND flash memory is becoming widely used as storage media for mobile devices such as mobile phones, MP3 players, PDAs and digital cameras. MLC NAND flash memory, however, has some restrictions that hard disk or Single-...
A hybrid flash translation layer design for SLC-MLC flash memory based multibank solid state disk

This paper presents the design of a NAND flash based solid state disk (SSD), which can support various storage access patterns commonly observed in a PC environment. It is based on a hybrid model of high-performance SLC (single-level cell) NAND and low ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data

June 2007

1210 pages

ISBN:9781595936868

DOI:10.1145/1247480

General Chairs:
Lizhu Zhou
Tsinghua University, China
,
Tok Wang Ling
National University of Singapore, Singapore
,
Program Chair:
Beng Chin Ooi
National University of Singapore, Singapore

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGMOD/PODS07

Sponsor:

SIGMOD/PODS07: International Conference on Management of Data

June 11 - 14, 2007

Beijing, China

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

280
Total Citations
View Citations
195
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)8

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim CSon YKim S(2024)Investigating the effects of SQL hints on diverse storage devices through empirical analysisCluster Computing10.1007/s10586-024-04853-128:2Online publication date: 26-Nov-2024
https://doi.org/10.1007/s10586-024-04853-1
Nguyen LLee SNam B(2022)In-page shadowing and two-version timestamp ordering for mobile DBMSsProceedings of the VLDB Endowment10.14778/3551793.355180215:11(2402-2414)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.14778/3551793.3551802
Han JSon Y(2022)An Efficient Block Address Transformation Scheme in Block Layer for Flash-Based SSDsIEEE Access10.1109/ACCESS.2022.314685210(14236-14245)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3146852
Sajjad MYusoff MAhmad J(2022)Design of a Low-Cost High-Speed and Large-Capacity Data Logger Using MicroSD CardInternational Conference on Artificial Intelligence for Smart Community10.1007/978-981-16-2183-3_63(651-657)Online publication date: 14-Nov-2022
https://doi.org/10.1007/978-981-16-2183-3_63
Choi JHong JKwon YHan HGavrilovska AZadok E(2020)LibnvmmioProceedings of the 2020 USENIX Conference on Usenix Annual Technical Conference10.5555/3489146.3489147(1-16)Online publication date: 15-Jul-2020
https://dl.acm.org/doi/10.5555/3489146.3489147
Kim BKim GLee D(2020)A Novel B-Tree Index with Cascade Memory Nodes for Improving Sequential Write Performance on Flash Storage DevicesApplied Sciences10.3390/app1003074710:3(747)Online publication date: 21-Jan-2020
https://doi.org/10.3390/app10030747
Bonnet PBouganim LKoltsidas IViglas S(2020)System co-design and data management for flash devicesProceedings of the VLDB Endowment10.14778/3402755.34028074:12(1504-1505)Online publication date: 3-Jun-2020
https://dl.acm.org/doi/10.14778/3402755.3402807
Kim KLee SMoon BPark CHwang J(2020)IPL-PProceedings of the VLDB Endowment10.14778/3402755.34027714:12(1363-1366)Online publication date: 3-Jun-2020
https://dl.acm.org/doi/10.14778/3402755.3402771
Jin PYang CWang XYue LZhang D(2020)SAL-Hashing: A Self-Adaptive Linear Hashing Index for SSDsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2018.288471432:3(519-532)Online publication date: 1-Mar-2020
https://doi.org/10.1109/TKDE.2018.2884714
Oh SKim WSeo JSong HNoh SNam B(2020)Doubleheader Logging: Eliminating Journal Write Overhead for Mobile DBMS2020 IEEE 36th International Conference on Data Engineering (ICDE)10.1109/ICDE48307.2020.00111(1237-1248)Online publication date: Apr-2020
https://doi.org/10.1109/ICDE48307.2020.00111
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents