Abstract
Real-time processing is a key problem for big data analysis and processing, especially in emergency management. Strongly promoted by the leading industrial companies, cloud computing becomes increasingly popular tool for emergency management, that is emergency management cloud. How to make optimal deployment of emergency management cloud applications is a challenging research problem. The paper proposes a multi-node scheduling algorithm based on clustering analysis and data partitioning in emergency management cloud. First, the presented method divides the cloud nodes into clusters according to the communication cost between different nodes, and then selects a cluster for the big data analysis services. Second, the load balancing theory is used to dispatch big data analysis to these computing nodes in a way to enable synchronized completion at best-effort performance. At last, to improve the real-time of big data analysis, the paper presents a multi-node scheduling algorithm based on game theory to find optimal scheduling strategy for each scheduling node. Experimental results show the effectiveness of our scheduling algorithm for big data analytics in emergency management.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Atzori, L., Iera, A., Morabito, G.: The internet of things: A survey. Computer Networks 54(15), 2787–2805 (2010)
Kortuem, G., Kawsar, F., Fitton, D., et al.: Smart objects as building blocks for the internet of things. IEEE Internet Computing 14(1), 44–51 (2010)
Ashton, K.: That ‘Internet of Things’ Thing. RFiD Journal 22, 97–114 (2009)
Qin, X.-P., Wang, S.: Big Data Analysis—Competition and Symbiosis of RDBMS and MapReduce. Journal of Software 23(1), 32–45 (2012)
Cheng, Y., Qin, C., Rusu, F.: GLADE: big data analytics made easy. In: Proc. of the 28th International Conference on Management of Data, pp. 697–700 (2012)
Velev, D., Zlateva, P.: Principles of Cloud Computing Application in Emergency Management. In: Proc. of the International Conference on E-business, Management and Economics, pp. 119–123 (2011)
Iosup, A., Ostermann, S., Yigitbasi, M.N., et al.: Performance analysis of cloud com-puting services for many-tasks scientific computing. IEEE Trans. on Parallel and Distributed Systems 22(6), 931–945 (2011)
Zhang, Y., Huang, G., Liu, X.: Integrating resource consumption and allocation for infrastructure resources on-demand. In: Proc. of the 3rd IEEE International Conference on Cloud Computing, pp. 75–82 (2010)
Budati, K., Sonnek, J., Chandra, A.: Ridge: combining reliability and performance in open grid platforms. In: Proc. of the 16th International Symposium on High Performance Distributed Computing, pp. 55–64 (2007)
Frey, J., Tannenbaum, T., Livny, M.: Condor-G: A computation management agent for multi-institutional grids. Cluster Computing 5(3), 237–246 (2002)
Kim, H., Parashar, M.: CometCloud: An Autonomic Cloud Engine. Cloud Computing: Principles and Paradigms, 275–297 (2011)
Chen, Q., Hsu, M., Zeller, H.: Experience in Continuous analytics as a Service (CaaaS). In: Proc. of the 14th ACM International Conference on Extending Database Technology, pp. 509–514 (2011)
Huang, Y.C., Ho, Y.C., Lu, C.H., et al.: A cloud-based accessible architecture for large-scale adl analysis services. In: Proc. of the 4th IEEE International Conference on Cloud Computing, pp. 646–653 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Q., Chen, Z., Zhao, L. (2013). Multi-node Scheduling Algorithm Based on Clustering Analysis and Data Partitioning in Emergency Management Cloud. In: Gao, Y., et al. Web-Age Information Management. WAIM 2013. Lecture Notes in Computer Science, vol 7901. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39527-7_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-39527-7_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39526-0
Online ISBN: 978-3-642-39527-7
eBook Packages: Computer ScienceComputer Science (R0)