Cited By
View all- Kargar SMohammad-Khanli L(2017)FractalJournal of Network and Computer Applications10.1016/j.jnca.2017.03.02187:C(147-168)Online publication date: 1-Jun-2017
Data resource discovery model based on hybrid architecture in data grid environment
Pages 507 - 525
Abstract
Today, the management of massive data collections draws much attention as data grids have been developed to deal with large computational problems and provide the opportunity for sharing geographically distributed resources for largeï scale dataï intensive applications. Therefore, finding an effective approach to discover data resources in order to promote better interactions between application communities or virtual organizations becomes a critical challenge. Traditional grid resource discovery models are mostly based on central and hierarchical architecture that can lead to bottlenecking with the expansion of the grid scale. Although the Peerï toï Peer P2P technique is integrated into the grid in order to improve the performance in recent years, each P2P structure still has drawbacks that require several compensatory strategies. In this paper, based on the unstructured superï nodeï based architecture from the P2P system, we design a structured logic resource tree in each domain in order to effectively alleviate the load on the superï node, and we propose a query recording learning algorithm based on this hybrid architecture to reduce traffic in the network and greatly shorten the response time. The model and algorithm are validated by simulations and compared with the traditional superï peer model and the floodingï based approach. Copyright © 2014 John Wiley & Sons, Ltd.
References
[1]
Hameurlain A, Morvan F, El Samad M. Large scale data management in grid systems: a survey. IEEE International Conference on Information and Communication Technologies: From Theory to Applications ICTTA , Damascus, 2008; pp.1-6.
[2]
Gagliardi F, Jones B, Reale M. European DataGrid Project: experiences of deploying a large scale testbed for e-science applications. Proceeding of the IFIP WG International Symposium Computer Performance Modeling, Measurement and Evaluation , Rome, Italy, 2002; pp.480-500.
[3]
Nefedova V, Jacob R, Foster I, Liu Z, Liu Y, Deelman E, Mehta G, Su MH, Vahi K. Automating climate science: Large ensemble simulations on the TeraGrid with the GriPhyN virtual data system. Second IEEE International Conference on e-Science and Grid Computing , Amsterdam, The Netherlands, 2006; pp.32-38.
[4]
Abdullah A, Othman M, Sulaiman MN, Ibrahim H, Othman AT. Data discovery algorithm for scientifc data grid environment. Journal of Parallel and Distributed Computing 2005; Volume 65 Issue 11: pp.1429-1434.
[5]
Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S. The data grid: towards an architecture for the distributed management and analysis of large scientific data sets. Journal of Network and Computer Applications 1999; Volume 23 Issue 3: pp.187-200.
[6]
Singh G, Bharathi S, Chervenak A, Deelman E, Kesselman C, Manohar M, Patil S, Pearlman L. A metadata catalog service for data intensive applications. SC'03 Proceedings of the 2003 ACM/IEEE conference on Supercomputing , Phoenix, 2003; pp.33-49.
[7]
Rajasekar A, Wan M, Moore R, Schroeder W, Kremenek G, Jagatheesan A, Cowart C, Zhu B, Chen SY, Olschanowsky R. Storage resource broker - managing distributed data in a grid. Computer Society of India Journal, Special Issue on SAN 2003; Volume 33: pp.42-54.
[8]
Jamali MAJ, Sani Y. Adaptive peer to peer resource discovery in grid computing based on reinforcement learning. 2011 12th ACIS International Conference on Software Engineering, Artificial Intelligence Networking and Parallel Distributed Computing, SNPD 2011 , 2011; pp.191-196.
[9]
Chen D, Chang G, Zheng X, Sun D, Li J, Wang X. A novel P2P based grid resource discovery model. Journal of Networks 2011; Volume 6 Issue 10: pp.1390-1397.
[10]
Xiong Z, Zhang X. Resource management architecture and genetic ant algorithm for P2PGrid system. Journal of Computational Information Systems 2011; Volume 6 Issue 1: pp.79-88.
[11]
Cokuslu D, Hameurlain A, Erciyes K. Grid resource discovery based on centralized and hierarchical architectures. International Journal for InfonomicsIJI 2010; Volume 3 Issue 1: pp.227-233.
[12]
Chang R, Hu M. A resource discovery tree using bitmap for grids. Future Generation Computer System 2010; Volume 26 Issue 1: pp.29-37.
[13]
Khanli LM, Kargar S. FRDT: footprint resource discovery tree for grids. Future Generation Computer Systems 2011; Volume 27 Issue 2: pp.148-156.
[14]
Mastroianni C, Talia D, Verta O. Designing an information system for grids: comparing hierarchical, decentralized P2P and super-peer models. Parallel Computing 2008; Volume 34 Issue 10: pp.593-611.
[15]
Ripeanu M. Peer-to-Peer architecture case study: Gnutella network. Proceedings of First International Conference on Peer-to-Peer Computing , Linkoping, 2001; pp.99-100.
[16]
Iamnitchi A, Foster IT, Nurmi DC. A peer-to-Peer approach to resource location in grid environments. Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing , Edinburgh, 2002; pp.413-429.
[17]
Jamali MAJ, Sani Y. Adaptive peer to peer resource discovery in grid computing based on reinforcement learning. 2011 12th ACIS International Conference on Software Engineering, Artificial Intelligence Networking and Parallel Distributed Computing, SNPD 2011 , Sydney, 2011; pp.191-196.
[18]
Stoica I, Morris R, Nowell DL, Karger DR, Kaashoek FM, Dabek F, Balakrishnan H. Chord: a scalable peer-to-Peer lookup service for internet applications. IEEE/ACM Transactions on Networking 2003; Volume 11 Issue 1: pp.17-32.
[19]
Rowstron A, Druschel P. Pastry: scalable, decentralized object location and routing for large scale peer-to-peer systems. Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg , London, 2001; pp.329-350.
[20]
Ratnasamy S, Francis P, Handley M, Karp R, Shenker S. A scalable content-addressable network. Proceeding of the 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication , California, August 2001; pp.161-72.
[21]
Schmidt C, Parashar M. Flexible information discovery in decentralized distributed systems. Proceedings of the 12th International Symposium on High-Performance Distributed Computing , Seattle, Washington, June 2003; pp.226-35.
[22]
Cai M, Frank M, Chen J, Szekely P. MAAN: A multi-attribute addressable network for grid information services. Proceedings of the 4th International Workshop on Grid Computing , Phoenix, AZ, USA, November 2003; pp.184-91.
[23]
Ramabhadran S, Ratnasamy S, Hellerstein JM, Shenker S. Brief announcement: prefix hash tree. Proceedings on Principles of Distributed Computing PODC , 2004; pp.368-368.
[24]
Zheng C, Shen G, Li S, Shenker S. Distributed segment tree: Support of range query and cover query over dht. Proceedings of the International Workshop on Peer-to-Peer Systems , Santa Barbara, CA, USA, 2006.
[25]
Tang Y, Zhou S, Xu J. LIGHT: a query-efficient yet low?maintenance indexing scheme over DHTs. IEEE Transactions on Knowledge and Data Engineering 2010; Volume 22 Issue 1: pp.59-75.
[26]
Fu Y, Hu R, Chen J, Wang Z, Tian G. An improved lookup algorithm on over-DHT paradigm based P2P network. Lecture Notes in Computer Science 2011; Volume 6987: pp.200-7.
[27]
Li M, Qi M. Facilitating resource discovery in grid environments with peer-to-peer structured tuple spaces. Peer-to-Peer Networking and Applications 2009; Volume 2: pp.283-97.
[28]
Leibowitz N, Ripeanu M, Wierzbicki A. Deconstructing the Kazaa network. Proceedings of the third IEEE Workshop on Internet Applications , San Jose, California, June 23-24, 2003; pp.112-120.
[29]
Mastroianni C, Talia D, Verta O. A super-peer model for resource discovery services in large-scale grids. Future Generation Computer Systems 2005; Volume 21 Issue 8: pp.1235-48.
[30]
Zhao S, Chen G, Wu G, Qian N. A strategy for selecting super-peer in p2p and grid based hybrid system. Technologies for E-Learning and Digital Entertainment 2008; Volume 5093: pp.192-9.
[31]
Xiong Z, Zhang X. Resource management architecture and genetic ant algorithm for P2PGrid system. Journal of Computational Information Systems 2011; Volume 6 Issue 1: pp.79-88.
[32]
Somasundaram TS, Balachandar RA, Kandasamy V, Buyya R, Raman R, Mohanram N, Varun S. Semantic-based grid resource discovery and its integration with the grid service broker. International Conference on Advanced Computing and Communications , Mangalore, India, December 2006; pp.84-9.
[33]
Vega-Gorgojo G, Bote-Lorenzo ML, Gmez-Snchez E, Dimitriadis V, Asensio-Prez JI. A semantic approach to discovering learning services in grid-based collaborative systems. Future Generation Computer Systems 2006; Volume 22 Issue 6: pp.709-9.
[34]
Lee S, Seo W, Kang D, Kim K, Lee JY. A framework for supporting bottom-up ontology evolution for discovery and description of Grid services. Expert Systems with Applications 2007; Volume 32 Issue 2: pp.376-85.
[35]
Hassan MI, Abdullah A. Semantic-based grid resource discovery systems: a literature review and taxonomy. Proceedings of 2010 International Symposium on Information Technology - System Development and Application and Knowledge Society, ITSim'10 , Kuala Lumpur, Malaysia, June 2010; pp.1286-96.
[36]
Somasundaram TS, Balachandar RA, Kandasamy V, Buyya R, Raman R, Mohanram N, Varun S. Semantic based Grid resource discovery and its integration with the grid service broker. International Conference on Advanced Computing and Communications , Surathkal, December 2006; pp.84-9.
[37]
Groleau W, Vlassov V, Popov K. Towards semantics-based resource discovery for the grid. Integrated Research in GRID Computing , Pisa, Italy, November 28-30, 2005; pp.175-87.
[38]
Heine F, Hovestadt M, Kao O. Towards ontology-driven P2P Grid resource discovery. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing , Pittsburgh, USA, November 2004; pp.76-83.
[39]
Ketata I, Mokadem R, Morvan F. Resource discovery considering semantic properties in data grid environments. Lecture Notes in Computer Science including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics 2011; Volume 6864: pp.61-72.
[40]
Li J, Vuong S. Grid resource discovery based on semantic P2P communities. Proceedings of the 2006 ACM Symposium on Applied Computing, SAC'06 , Dijon, France, April 2006; pp.754-8.
[41]
Kou Y, Yu G, Shen D, Li D, Nie T. PS-GIS: personalized and semantics-based grid information services. Proceedings of the 2nd International Conference on Scalable Information Systems, InfoScale'07 , Suzhou, China, article No. 11, June 2007; pp.11-11.
[42]
Mastroianni C, Talia D, Verta O. A super-peer model for resource discovery services in large-scale Grids. Future Generation Computer Systems 2005; Volume 21 Issue 8: pp.1235-1248.
[43]
Sun H, Huai J, Liu Y, Buyya R. RCT: a distributed tree for supporting efficient range and multi-attribute queries in grid computing. Future Generation Computer Systems 2008; Volume 24 Issue 7: pp.631-643.
[44]
Denning PJ. The locality principle. Communications of the ACM 2005; Volume 48 Issue 7: pp.19-24.
[45]
Arab MN, Mirtaheri SL, Khaneghah EM, Sharifi M., Mohammadkhani M. Improving learning-based request forwarding in resource discovery through load-awareness. Globe'11 Proceedings of the 4th international conference on Data management in grid and peer-to-peer systems , Toulouse, France, September 1-2, 2011; pp.73-82.
[46]
Howell F, McNab R. SimJava. Available from: "http://www.dcs.ed.ac.uk/home/hase/simjava" {Accessed on 25 September 2012}.
- Data resource discovery model based on hybrid architecture in data grid environment
Recommendations
Data discovery algorithm for scientific data grid environment
Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part IIIn modern scientific computing communities, scientists are involved in managing massive amounts of very large data collections in a geographically distributed environment. Research in the area of grid computing has given us various ideas and solutions ...
A Multi-agent Approach for P2P Based Resource Discovery in Grids
JCAI '09: Proceedings of the 2009 International Joint Conference on Artificial IntelligenceGrids are likely to be the mainstay of distributed computing . Efficient Resource discovery mechanism is one of the fundamental requirement for Grid computing systems.Peer-to-peer organization of Grid resource discovery services would have several ...
A Resource Discovery Method Based on Multi-agents in P2P Systems
KES-AMSTA '07: Proceedings of the 1st KES International Symposium on Agent and Multi-Agent Systems: Technologies and ApplicationsA peer-to-peer (P2P) system consists of a number of decentralized distributed network nodes that are capable of sharing resources without centralized supervision. Many applications such as IP-phone, contents delivery network (CDN), distributed computing ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
John Wiley and Sons Ltd.
United Kingdom
Publication History
Published: 10 March 2015
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Dec 2024
Other Metrics
Citations
Cited By
View all- Kargar SMohammad-Khanli L(2017)FractalJournal of Network and Computer Applications10.1016/j.jnca.2017.03.02187:C(147-168)Online publication date: 1-Jun-2017