Analysis of Performance Improvement of Real-time Internet of Things Application Data Processing in the Movie Industry Platform
Author: 
Yang Meng Academic Editor: Amandeep KaurAuthors Info & Claims
Abstract
The goal of this study is to plan and develop complete strategies to improve the performance of film industry. The primary objectives of this study are to investigate a dataset generated by a IoT application and the nature of the data forms obtained, the speed of the data arriving rate, and the required query response time and to list the issues that the current film industry faces when attempting to handle IoT applications in real time. Finally, in film industry platforms, high performance with varied stream circulation levels of real-time IoT application information was realized. In this study, we proposed three alternative methods on top of the Storm platform, nicknamed Re-Storm, to improve the performance of IoT application data. Three different proposed strategies are (1) data stream graph optimization framework, (2) energy-efficient self-scheduling strategy, and (3) real-time data stream computing with memory DVFS. The work proposed a methodology for dealing with heterogeneous traffic-aware incoming rate of data streams Re-Storm at multiple traffic points, resulting in a short response time and great energy efficiency. It is divided into three parts, the first of which is a scientific model for fast response time and great energy efficiency. The distribution of resources is then considered using DVFS approaches, and successful optimum association methods are shown. Third is self-allocation of worker nodes towards optimizing DSG using hot swapping and making the span minimization technique. Furthermore, the testing findings suggest that Re-Storm outperforms Storm by 20–30% for real-time streaming data of IoT applications. This research focuses on high energy efficiency, short reaction time, and managing data stream traffic arrival rate. A model for a specific phase of data coming via IoT and real-time computing devices was built on top of the Storm platform. There is no need to change any software approach or hardware component in this design, but only merely add an energy-efficient and traffic-aware algorithm. The design and development of this algorithm take into account all of the needs of the data produced by IoT applications. It is an open-source platform with less prerequisites for addressing a more sophisticated big data challenge.
References
[1]
B. Albert, “Mining big data in real time,” Informatica, vol. 37, no. 1, pp. 15–20, 2013.
[2]
H. Mohanty, Big data: an introduction, p. 18, Springer, India, 2015.
[3]
E. Benkhelifa, M. Abdel-Maguid, S. Ewenike, and D. Heatley, “The Internet of Things: the eco-system for sustainable growth,” in Proceedings of the IEEE/ACS 11th Int. Conf. on Computer Systems and Applications, pp. 836–842, Doha, Qatar, November, 2014.
[4]
J. Li, Z. Bao, and Z. Li, “Modeling demand response capability by internet data centers processing batch computing jobs,” IEEE Transactions on Smart Grid, vol. 6, no. 2, pp. 737–747, 2015.
[5]
H. Shao, L. Rao, Z. Wang, X. Liu, Z. Wang, and K. Ren, “Optimal load balancing and energy cost management for internet data centers in deregulated electricity markets,” IEEE Transactions on Parallel and Distributed Systems, vol. 25, no. 10, pp. 2659–2669, 2014.
[6]
P. Deepak, N. Surya, R. Rajiv, and C. Jinjun, “A dynamic prime number based efficient security mechanism for big sensing data streams,” Journal of Computer and System Sciences, vol. 83, no. 1, pp. 22–42, 2016.
[7]
H. Demirkan and D. Delen, “Leveraging the capabilities of service-oriented decision support systems: putting analytics and big data in cloud,” Decision Support Systems, vol. 55, no. 1, pp. 412–421, 2013.
[8]
L. Neumeyer and B. Robbins, “S4 : distributed stream computing platform,” in Proceedings of the IEEE Int. Conf. on Data Mining Workshops, pp. 170–177, USA, Washington, DC, USA, October 2010.
[9]
A. Ahmed and J. F. Naughton, “Static optimization of conjunctive queries with sliding windows over infinite streams,” in Proceedings of the ACM SIGMOD int. conf. on Management of data, pp. 419–430, Paris, France, July, 2004.
[10]
A. Amini, T. Y. Wah, and H. Saboohi, “On density-based data streams clustering algorithms: a survey,” Journal of Computer Science and Technology, vol. 29, no. 1, pp. 116–141, 2014.
[11]
K. Arun, K. Vamshikrishna, V. Kaladhar, and G. V. Prabhakara Rao, “CASH: context aware scheduler for Hadoop,” in Proceedings of the Int. Conf. on Advances in Computing, Communications and Informatics, pp. 52–61, Chennai, India, September, 2012.
[12]
C. Aggarwal, J. Han, J. Han, P. Yu, and P. S. Yu, “A framework for on demand classification of evolving data streams,” IEEE Transactions on Knowledge and Data Engineering, vol. 18, no. 5, pp. 577–589, 2006.
[13]
J. Xu, Z. Chen, J. Tang, and S. Su, “T-storm: Traffic-aware Online Scheduling in Storm,” in Proceedings of the IEEE Int. Conf. on Distributed Computing Systems, pp. 535–544, Madrid, Spain, June, 2014.
[14]
S. Baskiyar and R. Abdel-Kader, “Energy aware DAG scheduling on heterogeneous systems,” Cluster Computing, vol. 13, no. 4, pp. 373–383, 2010.
[15]
C. H. Hsu, K. D. Slagter, S. C. Chen, and Y. C. Chung, “Optimizing energy consumption with task consolidation in clouds,” Information Sciences, vol. 258, no. 8, pp. 452–462, 2014.
[16]
D. Sun, G. Zhang, S. Yang, W. Zheng, S. U. Khan, and K. Li, Re-stream: Realtime and Energy-efficient Resource Scheduling in Big Data Stream Computing EnvironmentsInformation Sciences, vol. 319, pp. 92–112, 2015.
[17]
S. Zhuravlev, J. C. Saez, S. Blagodurov, A. Fedorova, and M. Prieto, “Survey of energy-cognizant scheduling techniques,” IEEE Transactions on Parallel and Distributed Systems, vol. 24, no. 7, pp. 1447–1464, 2013.
[18]
Z. Zong, A. Manzanares, X. Ruan, and X. Qin, “EAD and PEBD: two energy- aware duplication scheduling algorithms for parallel tasks on homogeneous clusters,” IEEE Transactions on Computers, vol. 60, no. 3, pp. 360–374, 2011.
[19]
Z. Zhao, L. Zhuoyue, and L. Shurong, “Preemptive two-level priority real-time scheduling strategy for node system in wireless sensor network,” in Proceedings of the Int. Conf. on Advanced Infocomm Technology, pp. 1–5, New York, USA, July, 2008.
[20]
D. Sun, G. Fu, X. Liu, and H. Zhang, “Optimizing data stream graph for big data stream computing in cloud datacenter environments,” Int. J. of Advancements in Computing Technology, vol. 6, no. 5, pp. 53–65, 2014.
[21]
S. Gurmeet, K. Manku, and M. Rajeev, “Approximate Frequency Counts over Data Streams,” in Proceedings of the 28th ACM Int. Conf. On Very Large Data Bases, pp. 346–357, Hong Kong, China, September, 2002.
[22]
I. Keslassy, M. Kodialam, T. V. Lakshman, and D. Stiliadis, “On guaranteed smoothscheduling for input-queued switches,” IEEE/ACM Transactions on Networking, vol. 13, no. 6, pp. 1364–1375, 2005.
[23]
N. Kim, J. Cho, and E. Seo, “Energy-credit scheduler: an energy-aware virtual machine scheduler for cloud systems,” Future Generation Computer Systems, vol. 32, no. 3, pp. 128–137, 2014.
[24]
X. Liu, N. Iftikhar, and X. Xie, “Survey of real-time processing systems for big data,” in Proceedings of the 18th Int. Database Engineering and Applications Symposium, pp. 356–361, New York, USA, July, 2014.
[25]
M. Stonebraker, U. Çetintemel, and S. Zdonik, “The 8 requirements of realtime stream processing,” ACM SIGMOD Record, vol. 34, no. 4, pp. 42–47, 2005.
[26]
D. Pedro and G. Hulten, “Mining high-speed data streams,” in Proceedings of the ACM Int. Conf. On Knowledge Discovery and Data Mining, pp. 71–80, Massachusetts, USA, August, 2000.
[27]
K. Singh and R. Kaur, “Hadoop: addressing challenges of big data,” in Proceedings of the 2014 IEEE Int. Advance Computing Conf, pp. 686–689, Navi Mumbai, India, February, 2014.
[28]
G. Sudipto, “Tight results for clustering and summarizing data streams,” in Proceedings of the ACM Int. Conf. Proceeding Series, pp. 268–275, St. Petersburg, Russia, March, 2009.
Index Terms
- Analysis of Performance Improvement of Real-time Internet of Things Application Data Processing in the Movie Industry Platform
Index terms have been assigned to the content through auto-classification.
Recommendations
Adaptive Internet of Things and Web of Things convergence platform for Internet of reality services
Recently, Internet of things (IoT) and Web of Things (WoT) lead us to the excellent era of connected everything device. However, the devices hardly show the property of the autonomous connectivity and the self-cooperation for applying in real-world ...
Internet of Things security
The Internet of things (IoT) has recently become an important research topic because it integrates various sensors and objects to communicate directly with one another without human intervention. The requirements for the large-scale deployment of the IoT ...
Application of integrated energy data processing based on real-time stream processing platform
ICCSMT '23: Proceedings of the 2023 4th International Conference on Computer Science and Management TechnologyIntegrated energy is an important component of the new power system, and its IoT components need to collect and process energy equipment measurement data in real time. In order to solve the problems of large batches of equipment measurement data, ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2022 Yang Meng.
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Publisher
Hindawi Limited
London, United Kingdom
Publication History
Published: 01 January 2022
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Jan 2025