[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/2430475.2430490acmotherconferencesArticle/Chapter ViewAbstractPublication PagesinternetwareConference Proceedingsconference-collections
short-paper

Constructing a data accessing layer for in-memory data grid

Published: 30 October 2012 Publication History

Abstract

In-memory data grid (IMDG) is a novel data processing middleware for Internetware. It provides higher scalability and performance compared with traditional rational database. However, because the data stored in IMDG must follow the key/value data model, new challenges have been proposed. One important aspect is that IMDG does not support standard data accessing languages such as JPA and SQL, and application developers must design their programs according to the peculiarities of an IMDG product. This results in complex and error-prone code, especially for the programmers who have no deep understanding of IMDG. In this paper, we propose a data accessing reference architecture for IMDG and a methodology to design and implement its data accessing layer. In this methodology, data accessing engine construction, data model designation and join operation supporting are presented. Moreover, following this methodology, we develop and implement a JPA compatible data accessing engine for Hazelcast as a case study, which proves the feasibility of our approach.

References

[1]
Hasso Plattner. 2009. A common database approach for OLTP and OLAP using an in-memory column database. In Proceedings of the 2009 ACM SIGMOD International Conference on Management of data (SIGMOD '09), Carsten Binnig and Benoit Dageville (Eds.). ACM, New York, NY, USA, 1--2.
[2]
J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. Communications of the ACM, 51(1): 107--113, 2008.
[3]
B. Chattopadhyay, L. Lin, W. Liu, S. Mittal, P. Aragonda, V. Lychagina, Y. Kwon, and M. Wong. Tenzing: A SQL Implementation on the MapReduce Framework. PVLDB, 4(12):1318--1327, 2011.
[4]
R. Lee, et al., "YSmart: Yet Another SQL-to-MapReduce Translator," 31st International Conference on Distributed Computing Systems (Icdcs 2011), pp. 25--36, 2011.
[5]
JPA: http://www.oracle.com/technetwork/articles/javaee/jpa-137156.html.
[6]
Terence Parr and Russell Quong. ANTLR: A predicated-LL(k) parser generator. Journal of Software Practice and Experience, 25(7), 1995.
[7]
Oracle Coherence: http://www.oracle.com/technetwork/middleware/coherence/overview/index.html.
[8]
GigaSpaces XAP: http://www.gigaspaces.com/datagrid.
[9]
VMware GemFire: http://www.vmware.com/products/application-platform/vfabric-gemfire/overview.html.
[10]
Hazelcast: http://www.hazelcast.com/.
[11]
Infinispan: http://www.jboss.org/infinispan/.
[12]
R. Pike, S. Dorward, R. Griesemer, and S. Quinlan. Interpreting the data: Parallel analysis with Sawzall. Scientifc Programming, 13(4):277--298, 2005.
[13]
C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: a not-so-foreign language for data processing. In Proceedings of the 2008 ACM SIGMOD international conference on Management of data, pages 1099--1110. ACM, 2008.
[14]
A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wycko_, and R. Murthy. Hive: a warehousing solution over a Map-Reduce framework. Proceedings of the VLDB Endowment, 2(2):1626--1629, 2009.
[15]
A. Abouzeid, K. Bajda-Pawlikowski, D. Abadi, A. Silberschatz, and A. Rasin. HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads. Proceedings of the VLDB Endowment, 2:922--933, August 2009.
[16]
G. L. Sanders and S. K. Shin. Denormalization effects on performance of RDBMS. In Proceedings of the HICSS Conference, January 2001.
[17]
S. K. Shin and G. L. Sanders. Denormalisation strategies for data retrieval from data warehouses. Decision Support Systems, 42(1):267--282, October 2006.
[18]
Caching policy: http://en.wikipedia.org/wiki/Cache_(computing).
[19]
Json: http://www.json.org/.
[20]
P. P. Chen. The Entity-Relationship Model: Towards a unified view of Data. ACM Transactions on Database Systems, 1:9--36, Jan 1976.
[21]
Z. Wei, G. Pierre, and C. H. Chi. Scalable Join Queries in Cloud Data Stores. 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. May 2012.
[22]
TPC-W: http://www.tpc.org/tpcw/default.asp.
[23]
Hibernate ORM: http://www.hibernate.org/.
[24]
OpenJPA: http://openjpa.apache.org/.
[25]
TopLink: http://www.oracle.com/technetwork/middleware/toplink/overview/index.html
[26]
M. Keith and M. Schnicariol, "Introduction Pro JPA 2," ed: Apress, 2010, pp. 1--16.

Cited By

View all
  • (2013)Determine the Hardware Choice to Improve HDFS Performance Deployed in a Commodity ClusterProceedings of the 2013 IEEE 16th International Conference on Computational Science and Engineering10.1109/CSE.2013.192(1295-1302)Online publication date: 3-Dec-2013

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
Internetware '12: Proceedings of the Fourth Asia-Pacific Symposium on Internetware
October 2012
204 pages
ISBN:9781450318884
DOI:10.1145/2430475
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • NJU: Nanjing University
  • Tsinghua University: Tsinghua University
  • CCF: China Computer Federation

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. data accessing
  2. in-memory data grid (IMDG)
  3. key/value data model

Qualifiers

  • Short-paper

Funding Sources

Conference

Internetware '12
Sponsor:
  • NJU
  • Tsinghua University
  • CCF

Acceptance Rates

Overall Acceptance Rate 55 of 111 submissions, 50%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 21 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2013)Determine the Hardware Choice to Improve HDFS Performance Deployed in a Commodity ClusterProceedings of the 2013 IEEE 16th International Conference on Computational Science and Engineering10.1109/CSE.2013.192(1295-1302)Online publication date: 3-Dec-2013

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media