Abstract
The event-driven programming model has been proposed to efficiently process iterative applications and incremental applications. In clusters based the event-driven model, applications are structured as a series of triggers, each of which will be invoked when associate events are trigged. And framework assigns a newly submitted trigger to a node where the relevant datasets set. Unfortunately it may lead to load imbalance because associate events occur by chance. Numerous triggers in a node may be simultaneously invoked but other nodes have no triggers running. Jobs composed of short, sub-second triggers present a difficult balancing challenge. To the end, we design DLBer, a new dynamic load balancing algorithm for the event-driven clusters to maximize improve the utilization of node resources.
Chapter PDF
Similar content being viewed by others
References
Peng, D., Dabek, F.: Large-scale Incremental Processing Using Distributed Transactions and Notifications. In: OSDI, vol. 10 (2010)
Mitchell, C., Power, R., Li, J.: Oolong: asynchronous distributed applications made easy. In: Proceedings of the Asia-Pacific Workshop on Systems. ACM (2012)
Dai, D., et al.: Domino: an incremental computing framework in cloud with eventual synchronization. In: Proceedings of the 23rd International Symposium on High-Performance Parallel and Distributed Computing, ACM (2014)
McCarthy, D., Dayal, U.: The architecture of an active database management system. ACM Sigmod Record 18(2), 215–224 (1989)
Willebeek-LeMair, M.H., Reeves, A.P.: Strategies for dynamic load balancing on highly parallel computers. IEEE Transactions on Parallel and Distributed Systems 4(9), 979–993 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Sun, M., Li, C., Zhou, X., Lu, K., Zhuang, H. (2014). DLBer: A Dynamic Load Balancing Algorithm for the Event-Driven Clusters. In: Hsu, CH., Shi, X., Salapura, V. (eds) Network and Parallel Computing. NPC 2014. Lecture Notes in Computer Science, vol 8707. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44917-2_64
Download citation
DOI: https://doi.org/10.1007/978-3-662-44917-2_64
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44916-5
Online ISBN: 978-3-662-44917-2
eBook Packages: Computer ScienceComputer Science (R0)