[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1807167.1807227acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article

Positional update handling in column stores

Published: 06 June 2010 Publication History

Abstract

In this paper we investigate techniques that allow for on-line updates to columnar databases, leaving intact their high read-only performance. Rather than keeping differential structures organized by the table key values, the core proposition of this paper is that this can better be done by keeping track of the tuple position of the modifications. Not only does this minimize the computational overhead of merging in differences into read-only queries, but this makes the differential structure oblivious of the value of the order keys, allowing it to avoid disk I/O for retrieving the order keys in read-only queries that otherwise do not need them - a crucial advantage for a column-store. We describe a new data structure for maintaining such positional updates, called the Positional Delta Tree (PDT), and describe detailed algorithms for PDT/column merging, updating PDTs, and for using PDTs in transaction management. In experiments with a columnar DBMS, we perform microbenchmarks on PDTs, and show in a TPC-H workload that PDTs allow quick on-line updates, yet significantly reduce their performance impact on read-only queries compared with classical value-based differential methods.

References

[1]
H. Berenson, P. Bernstein, J. Gray, J. Melton, E. O'Neil, P. O'Neil. A critique of ANSI SQL isolation levels. In Proc.SIGMOD, 1995.
[2]
P. Boncz. Monet: A Next-Generation DBMS Kernel For Query-Intensive Applications. Ph.D. Thesis, Universiteit van Amsterdam, May 2002.
[3]
P. Boncz, M. Zukowski, N. Nes. MonetDB/X100: Hyper-Pipelining Query Execution. In Proc. CIDR, 2005.
[4]
M. J. Cahill, U. Röhm, A. D. Fekete. Serializable isolation for snapshot databases. In Proc. SIGMOD, 2008.
[5]
G. Canahuate, M. Gibas, H. Ferhatosmanoglu. Update conscious bitmap indices. In Proc. SSDBM, 2007.
[6]
S. Chen, P. B. Gibbons, T. C. Mowry. Improving index performance through prefetching. In Proc. SIGMOD, 2001.
[7]
X. Chen, P. O'Neil, E. O'Neil. Adjoined dimension column clustering to improve data warehouse query performance. In Proc. ICDE, 2008.
[8]
A. Copeland and S. Khoshafian. A Decomposition Storage Model. In Proc. SIGMOD, 1985.
[9]
G. Graefe. Sorting and indexing with partitioned b-trees. In Proc. CIDR, 2003.
[10]
G. Graefe. Efficient Columnar Storage in B-trees. SIGMOD Record, 36(1), 2007.
[11]
G. Graefe. Fast loads and fast queries. In DaWaK, 2009.
[12]
J. Gray. The transaction concept: Virtues and limitations. In Proc. VLDB, pages 144--154, 1981.
[13]
H. V. Jagadish, P. P. S. Narayan, S. Seshadri, S. Sudarshan, R. Kanneganti. Incremental Organization for Data Recording and Warehousing. In Proc. VLDB, 1997.
[14]
G. Moerkotte. Small materialized aggregates: A light weight index structure for data warehousing. In Proc. VLDB, 1998.
[15]
C. Mohan, D. Haderle, B. Lindsay, H. Pirahesh, P. Schwarz. Aries: a transaction recovery method supporting fine-granularity locking and partial rollbacks using write-ahead logging. TODS, 17(1), 1992.
[16]
P. O'Neil, E. Cheng, D. Gawlick, E. O'Neil. The Log-Structured Merge-Tree. Acta Informatica, 33(4), 1996.
[17]
S. Padmanabhan, B. Bhattacharjee, T. Malkemus, L. Cranston, M. Huras. Multi-dimensional clustering: a new data layout scheme in db2. In Proc. SIGMOD, 2003.
[18]
S. Padmanabhan, T. Malkemus, R. Agarwal, A. Jhingran. Block oriented processing of relational database operations in modern computer architectures. In Proc. ICDE, 2001.
[19]
R. Ramamurthy, D. J. DeWitt, Q. Su. A Case for Fractured Mirrors. The VLDB Journal, 12(2):89--101, 2003.
[20]
D. Severance and G. Lohman. Differential Files: Their Application to the Maintenance of Large Databases. ACM Trans. Database Syst., 1(3), 1976.
[21]
D. Slezak and V. Eastwood. Data warehouse technology by InfoBright. In Proc. SIGMOD, 2009.
[22]
M. Stonebraker et al. C-Store: A Column-oriented DBMS. In Proc. VLDB, 2005.
[23]
S. Tatham. Counted B-trees. In www.chiark.greenend.org.uk/sgtatham/algorithms/cbtree.html, 2001.

Cited By

View all
  • (2024)Petabyte-Scale Row-Level Operations in Data LakehousesProceedings of the VLDB Endowment10.14778/3685800.368583417:12(4159-4172)Online publication date: 8-Nov-2024
  • (2023)Describing Inscriptions of Ancient Italy. The ItAnt Project and Its Information Encoding ProcessJournal on Computing and Cultural Heritage 10.1145/360670316:3(1-14)Online publication date: 9-Aug-2023
  • (2023)The Facets of Intangible Heritage in Southern Chinese Martial Arts: Applying a Knowledge-driven Cultural Contact Detection ApproachJournal on Computing and Cultural Heritage 10.1145/360670216:3(1-27)Online publication date: 9-Aug-2023
  • Show More Cited By

Index Terms

  1. Positional update handling in column stores

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMOD '10: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
    June 2010
    1286 pages
    ISBN:9781450300322
    DOI:10.1145/1807167
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 June 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    Author Tags

    1. columnstores
    2. pdt
    3. positional
    4. updates

    Qualifiers

    • Research-article

    Conference

    SIGMOD/PODS '10
    Sponsor:
    SIGMOD/PODS '10: International Conference on Management of Data
    June 6 - 10, 2010
    Indiana, Indianapolis, USA

    Acceptance Rates

    Overall Acceptance Rate 785 of 4,003 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 15 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Petabyte-Scale Row-Level Operations in Data LakehousesProceedings of the VLDB Endowment10.14778/3685800.368583417:12(4159-4172)Online publication date: 8-Nov-2024
    • (2023)Describing Inscriptions of Ancient Italy. The ItAnt Project and Its Information Encoding ProcessJournal on Computing and Cultural Heritage 10.1145/360670316:3(1-14)Online publication date: 9-Aug-2023
    • (2023)The Facets of Intangible Heritage in Southern Chinese Martial Arts: Applying a Knowledge-driven Cultural Contact Detection ApproachJournal on Computing and Cultural Heritage 10.1145/360670216:3(1-27)Online publication date: 9-Aug-2023
    • (2023)Procedural Modeling Based Shape Grammar as a Key to Generating Digital Architectural HeritageJournal on Computing and Cultural Heritage 10.1145/360670116:4(1-17)Online publication date: 9-Aug-2023
    • (2023)Model Counting Meets F0 EstimationACM Transactions on Database Systems10.1145/360349648:3(1-28)Online publication date: 9-Aug-2023
    • (2023)Enabling Timely and Persistent Deletion in LSM-EnginesACM Transactions on Database Systems10.1145/359972448:3(1-40)Online publication date: 9-Aug-2023
    • (2023)ICON: An Ontology for Comprehensive Artistic InterpretationsJournal on Computing and Cultural Heritage 10.1145/359472416:3(1-38)Online publication date: 9-Aug-2023
    • (2023)Wikibase Model for Premodern Manuscript Metadata Harmonization, Linked Data Integration, and DiscoveryJournal on Computing and Cultural Heritage 10.1145/359472316:3(1-25)Online publication date: 9-Aug-2023
    • (2023)New AIR for the Archaeological Process? The Use of 3D Web Semantic for Publishing Archaeological ReportsJournal on Computing and Cultural Heritage 10.1145/359472216:3(1-23)Online publication date: 9-Aug-2023
    • (2023)CLEF. A Linked Open Data Native System for CrowdsourcingJournal on Computing and Cultural Heritage 10.1145/359472116:3(1-17)Online publication date: 9-Aug-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media