demonstration

HadoopDB in action: building real world applications

Authors:

Azza Abouzied,

Kamil Bajda-Pawlikowski,

Jiewen Huang,

Daniel J. Abadi,

Avi SilberschatzAuthors Info & Claims

SIGMOD '10: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data

Pages 1111 - 1114

https://doi.org/10.1145/1807167.1807294

Published: 06 June 2010 Publication History

Get Access

Abstract

HadoopDB is a hybrid of MapReduce and DBMS technologies, designed to meet the growing demand of analyzing massive datasets on very large clusters of machines. Our previous work has shown that HadoopDB approaches parallel databases in performance and still yields the scalability and fault tolerance of MapReduce-based systems. In this demonstration, we focus on HadoopDB's flexible architecture and versatility with two real world application scenarios: a semantic web data application for protein sequence analysis and a business data warehousing application based on TPC-H. The demonstration offers a thorough walk-through of how to easily build applications on top of HadoopDB.

References

[1]

HadoopDB Project. http://hadoopdb.sourceforge.net.

Google Scholar

[2]

TPC-H. http://www.tpc.org/tpch/.

Google Scholar

[3]

Universal Protein Resource. http://www.uniprot.org/.

Google Scholar

[4]

D. J. Abadi, A. Marcus, S. R. Madden, and K. Hollenbach. SW-Store: A Vertically Partitioned DBMS for Semantic Web Data Management. VLDB Journal, 18(2), April 2009.

Digital Library

Google Scholar

[5]

A. Abouzeid, K. Bajda-Pawlikowski, D. J. Abadi, A. Silberschatz, and A. Rasin. HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads. In VLDB, 2009.

Digital Library

Google Scholar

[6]

K. Bajda-Pawlikowski. Querying RDF data stored in DBMS: SPARQL to SQL Conversion. Yale CS Technical Report TR-1409, 2008.

Google Scholar

[7]

C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig latin: a not-so-foreign language for data processing. In Proc. of SIGMOD, 2008.

Digital Library

Google Scholar

[8]

A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. R. Madden, and M. Stonebraker. A Comparison of Approaches to Large Scale Data Analysis. In SIGMOD, 2009.

Digital Library

Google Scholar

[9]

A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, N. Zhang, S. Antony, H. Liu, and R. Murth. Hive: A Petabyte Scale Data Warehouse Using Hadoop. In Proc. of ICDE, 2010.

Crossref

Google Scholar

[10]

W3C. Resource Description Framework. http://www.w3.org/RDF/.

Google Scholar

[11]

W3C. SPARQL Query Language for RDF. http://www.w3.org/TR/rdf-sparql-query/.

Google Scholar

Cited By

View all

Cui WZhang QBlanas SCamacho-Rodríguez JHaynes BLi YRamamurthy RCheng PSen RInterlandi M(2023)Query Processing on Gaming ConsolesProceedings of the 19th International Workshop on Data Management on New Hardware10.1145/3592980.3595313(86-88)Online publication date: 18-Jun-2023
https://dl.acm.org/doi/10.1145/3592980.3595313
Gui DHe G(2021)Distributed Multi-Dimensional Data Index Strategy in Cloud Computing Environment2021 5th International Conference on Electronics, Communication and Aerospace Technology (ICECA)10.1109/ICECA52323.2021.9675845(01-04)Online publication date: 2-Dec-2021
https://doi.org/10.1109/ICECA52323.2021.9675845
Dabbèchi HNabli ABouzguenda LHaddar K(2018)DWIaaS: Data Warehouse Infrastructure as a Service for Big Data AnalyticsTransactions on Computational Collective Intelligence XXX10.1007/978-3-319-99810-7_7(133-151)Online publication date: 24-Sep-2018
https://doi.org/10.1007/978-3-319-99810-7_7
Show More Cited By

Index Terms

HadoopDB in action: building real world applications
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database query processing
      2. Parallel and distributed DBMSs
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
      1. Database query processing and optimization (theory)

Recommendations

PARADISE: Big data analytics using the DBMS tightly integrated with the distributed file system

There has been a lot of research on MapReduce for big data analytics. This new class of systems sacrifices DBMS functionality such as query languages, schemas, or indexes in order to maximize scalability and parallelism. However, as high functionality ...
Big data analysis and query optimization improve HadoopDB performance
SEM '14: Proceedings of the 10th International Conference on Semantic Systems

High performance and scalability are two essentials requirements for data analytics systems as the amount of data being collected, stored and processed continue to grow rapidly. In this paper, we propose a new approach based on HadoopDB. Our main goal ...
The Era of Big Spatial Data: Challenges and Opportunities
MDM '15: Proceedings of the 2015 16th IEEE International Conference on Mobile Data Management - Volume 02

This seminar describes the state-of-the-art research in the area of big spatial data and it consists of four parts. Part I gives a background about big spatial data and the limitations of traditional systems in handling such data. Part II gives an ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SIGMOD '10: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data

June 2010

1286 pages

ISBN:9781450300322

DOI:10.1145/1807167

General Chair:
Ahmed Elmagarmid
Purdue University, USA
,
Program Chair:
Divyakant Agrawal
University of California at Santa Barbara, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

SIGMOD/PODS '10

Sponsor:

SIGMOD

SIGMOD/PODS '10: International Conference on Management of Data

June 6 - 10, 2010

Indiana, Indianapolis, USA

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,279
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cui WZhang QBlanas SCamacho-Rodríguez JHaynes BLi YRamamurthy RCheng PSen RInterlandi M(2023)Query Processing on Gaming ConsolesProceedings of the 19th International Workshop on Data Management on New Hardware10.1145/3592980.3595313(86-88)Online publication date: 18-Jun-2023
https://dl.acm.org/doi/10.1145/3592980.3595313
Gui DHe G(2021)Distributed Multi-Dimensional Data Index Strategy in Cloud Computing Environment2021 5th International Conference on Electronics, Communication and Aerospace Technology (ICECA)10.1109/ICECA52323.2021.9675845(01-04)Online publication date: 2-Dec-2021
https://doi.org/10.1109/ICECA52323.2021.9675845
Dabbèchi HNabli ABouzguenda LHaddar K(2018)DWIaaS: Data Warehouse Infrastructure as a Service for Big Data AnalyticsTransactions on Computational Collective Intelligence XXX10.1007/978-3-319-99810-7_7(133-151)Online publication date: 24-Sep-2018
https://doi.org/10.1007/978-3-319-99810-7_7
Ordonez CBellatreche L(2018)A Survey on Parallel Database Systems from a Storage Perspective: Rows Versus ColumnsDatabase and Expert Systems Applications10.1007/978-3-319-99133-7_1(5-20)Online publication date: 7-Aug-2018
https://doi.org/10.1007/978-3-319-99133-7_1
Eltabakh M(2018)Big Data IndexingEncyclopedia of Big Data Technologies10.1007/978-3-319-63962-8_255-1(1-11)Online publication date: 9-May-2018
https://doi.org/10.1007/978-3-319-63962-8_255-1
Pang ZWu SChen GChen KShou L(2017)FlashViewProceedings of the VLDB Endowment10.14778/3137765.313779610:12(1869-1872)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.14778/3137765.3137796
Eltabakh M(2017)Data Organization and Curation in Big DataHandbook of Big Data Technologies10.1007/978-3-319-49340-4_5(143-178)Online publication date: 26-Feb-2017
https://doi.org/10.1007/978-3-319-49340-4_5
Khalifa SElshater YSundaravarathan KBhat AMartin PImam FRope DMcroberts MStatchuk C(2016)The Six Pillars for Building Big Data Analytics EcosystemsACM Computing Surveys10.1145/296314349:2(1-36)Online publication date: 2-Aug-2016
https://dl.acm.org/doi/10.1145/2963143
Luo XWu B(2016)Predicate-Oriented Query of RDF Data Based on a Distributed Storage Model2016 IEEE First International Conference on Data Science in Cyberspace (DSC)10.1109/DSC.2016.43(37-43)Online publication date: Jun-2016
https://doi.org/10.1109/DSC.2016.43
Zhao YZhang YYao YLi YLiu P(2015)Cocktail: A hybrid system combining Hadoop and Storm2015 IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC)10.1109/IAEAC.2015.7428510(20-25)Online publication date: Dec-2015
https://doi.org/10.1109/IAEAC.2015.7428510
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

PARADISE: Big data analytics using the DBMS tightly integrated with the distributed file system

Big data analysis and query optimization improve HadoopDB performance

The Era of Big Spatial Data: Challenges and Opportunities