Abstract
We propose a new scheme for creating replica based on network coding in grid environments. For creating replica with network coding, there are two models: encoding between blocks of a replica and encoding between blocks of different replicas. The former is based on a butterfly-shaped topology, and the latter, in theory, based on any topology with a node more than one degree. Based on the latter model, furthermore, in practice, we propose a double-funnel-shaped topology. To evaluate our models, we extend NS2 by improving functions, modifying and adding classes. Compare to traditional strategies of creating replica, our experiment showed the strategy with network coding can improve data access time and I/O bottlenecks, low bandwidth consumption, or improve load balancing, increase robustness for being in support of departure of nodes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Villa, A.H., Varki, E.: Co-allocation in Data Grids: A Global, Multi-user Perspective. In: Wu, S., Yang, L.T., Xu, T.L. (eds.) GPC 2008. LNCS, vol. 5036, pp. 152–165. Springer, Heidelberg (2008)
Cho, A.: Large Hadron Collider: The Overture Begins. Science 321(5894), 1287–1289 (2008)
Cohen, B.: Incentives build robustness in bittorrent. In: P2P Economics Workshop, Berkeley, CA (2003)
Fragouli, C., Widmer, J., LeBoudec, J.Y.: A network coding approach to energy efficient broadcasting: from theory to practice. In: Infocom 2006 (March 2006)
Gkantsidis, C., Rodriguez, P.R.: Network coding for large scale content distribution. In: Proc. IEEE Infocom 2005, March 2005, vol. 4, pp. 2235–2245 (2005)
E-science Topology, http://www.e-science.ox.ac.uk/oxford/griduk.gif
Ho, T., Koetter, R., Medard, M., et al.: A random linear network coding approach to multicast. IEEE Transactions on Information Theory 52(10), 4413–4430 (2006)
Lamehamedi, H., Szymanski, B., Shentu, Z., Deelman, E.: Data replication strategies in grid environments. In: Proceedings of 5th International Conference on Algorithms and Architecture for Parallel Processing, pp. 378–383 (2002)
Ranganathan, K., Foster, I.: Identifying dynamic replication strategies for a high-performance data grid. In: Proceeding of the Second International Workshop on Grid Computing, Denver, November 2001, pp. 75–86 (2001)
Ma, G., Xu, Y., Lin, M., Xuan, Y.: A Content Distribution System based on Sparse Linear Network Coding. In: Third Workshop on Network Coding, Netcod 2007 (2007)
Madi, M.K., Hassan, S.: Dynamic Replication Algorithm in Data Grid: Survey. In: International Conference on Network Applications, Protocols and Services 2008 (NerApps 2008), Malaysia (November 2008)
Chou, P., Wu, Y., Jain, K.: Network coding for the internet. In: IEEE Communication Theory Workshop, Capri. IEEE, Los Alamitos (2004)
Chang, R.-S., Wang, C.-M., Chen, P.-H.: Replica selection on co-allocation data Grids. In: Cao, J., Yang, L.T., Guo, M., Lau, F. (eds.) ISPA 2004. LNCS, vol. 3358, pp. 584–593. Springer, Heidelberg (2004)
Ahlswede, R., Cai, N., Li, S.R., Yeung, R.W.: Network information flow. IEEE Transactions on Information Theory (2000)
Chang, R.S., Chen, P.H.: Complete and fragmented replica selection and retrieval in Data Grids. Future Generation Computer Systems 23, 536–546 (2007)
Vazhkudai, S.: Enabling the Co-allocation of Grid data transfers. In: Proceedings of International Workshop on Grid Computing, Phoenix, Arizona, USA, November 17, pp. 44–51 (2003)
Katti, S., Rahul, H., Katabi, D., Hu, W., Médard, M., Crowcroft, J.: XORs in the Air:Practical Wireless Network Coding. In: SIGCOMM (2006)
Lin, Y.F., Wu, J.J., Liu, P.: A List-Based Strategy for Optimal Replica Placement in Data Grid Systems. In: ICPP 2008. 37th International Conference on Parallel Processing, 2008, Portland, Oregon, September 9-12, pp. 198–205 (2008)
Zissimos, A., Doka, K., Chazapis, A., Koziris, N.: GridTorrent: Optimizing data transfers in the Grid with collaborative sharing. Presented at 11th Panhellenic Conference on Informatics, PCI 2007, Patras, Greece (May 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, B., Hong, J., Li, L., Long, D. (2010). Network Coding for Creating Replica in Grid Environments. In: Zhang, W., Chen, Z., Douglas, C.C., Tong, W. (eds) High Performance Computing and Applications. Lecture Notes in Computer Science, vol 5938. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11842-5_55
Download citation
DOI: https://doi.org/10.1007/978-3-642-11842-5_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-11841-8
Online ISBN: 978-3-642-11842-5
eBook Packages: Computer ScienceComputer Science (R0)