Abstract
There is a tremendous demand for resources due to the different emerging IoT applications that must be fulfilled. The large-scale resource-constrained IoT ecosystem needs a novel and robust technique to manage resources. An optimal resource provisioning in IoT ecosystem has to handle the mapping of request-resource and is hard to achieve as the IoT requests and resources are dynamic and heterogeneous. Therefore, artificial intelligence (AI) has a vital role in the IoT network. As changes are dynamic, global optimization cannot be achieved due to classifiers of the wireless signals and high interference. In this research, spectrum selection is integrated with spectrum access by the use of reinforcement learning with stochastic-based reward measures for efficient resource allocation in WSN-IoT applications. Here, state–action–reward–state–action approach with the Gittins index named SARSA-GI is involved. The role of the state–action–reward–state–action model is developed with an energy-efficient approach for optimizing the channel. Next, the Gittins index is designed to reduce the delay and enhance the accuracy of spectrum access. The simulation results are compared with two state-of-the-art methods which achieve 91.4% of reliability, 88.4% of transmission probability, 93.4% of throughput, 66.8% of collision performance, and 57.2% of signal-to-interference noise ratio.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Diro A, Chilamkurti N (2018) Distributed attack detection scheme using deep learning approach for internet of things. J Future Gener Comput Syst 82:1–11
Diro A, Reda H, Chilamkurti N (2018) Differential flow space allocation scheme in SDN based fog computing for IoT applications. J Ambient Intell Human Comput 22:1–11
Hossain E, Niyato D, Han Z (2009) Dynamic spectrum access and management in cognitive radio networks. Cambridge University Press, Cambridge
Wang N, Gao Y, Zhang X (2013) Adaptive spectrum sensing algorithm under different primary user utilizations. IEEE Commun Lett 17(9):1838–1841
Tandra R, Sahai A (2005) Fundamental limits on detection in low SNR under noise uncertainty. In: International conference on wireless networks, communications and mobile computing, pp 464–469
Rauniyar A, Shin SY (2015) Multiple antenna-aided cascaded energy and matched filter detector for cognitive radio networks. Int J Distrib Sens Netw 11(9):1–9
Khambekar N, Dong L, Chaudhary V (2007) Utilizing OFDM guard interval for spectrum sensing. In: Proceedings of the IEEE wireless communication and networking conference, pp 38–42
Zeng Y, Liang YC, Hoang AT, Zhang R (2010) A review on spectrum sensing techniques for cognitive radio: challenges and solutions. EURASIP J Adv Signal Process, pp 1–15
Liang YC, Chen K, Li GY, Mahonen P (2011) Cognitive radio networking and communications: an overview. IEEE Trans Veh Technol 60(7):3386–3407
Cheng H, Su Z, Xiong N, Xiao Y (2016) Energy-efficient node scheduling algorithms for wireless sensor networks using Markov Random Field model. Inf Sci 329:461–477
Larsson E, Skoglund M (2008) Cognitive radio in a frequency-planned environment: some basic limits. IEEE Trans Wireless Commun 7(12):4800–4806
Axell E, Leus G, Larsson EG, Poor HV (2012) Spectrum sensing for cognitive radio: state-of-the-art and recent advances, IEEE Signal Process Mag 29(3):101–116
Noh G, Wang H, Jo J, Kim BH, Hong D (2011) Reporting order control for fast primary detection in cooperative spectrum sensing. IEEE Trans Veh Technol 60(8):4058–4063
Vien QT, Stewart BG, Tianfield H, Nguyen HX (2013) Efficient cooperative spectrum sensing for three‐hop cognitive wireless relay networks. IET Commun 7(2):119–127
Gezer A , Okdem S (2020) Improving IEEE 802.15. 4 channel access performance for IoT and WSN devices. Comput Electr Eng
Okdem S (2017) A real‐time noise resilient data link layer mechanism for unslotted IEEE 802.15. 4 networks. Int J Commun Syst
Xue T, Dong X, Shi Y (2017) Resource-allocation strategy for multiuser cognitive radio systems: location-aware spectrum access. IEEE Trans Veh Technol 66(1):884–889
Khan H, Yoo SJ (2015) Dynamic interference control in OFDM-based cognitive radio network using genetic algorithm. Taylor & Francis
Bhorkar AA, Naghshvar M, Javidi T, Rao BD (2012) Adaptive opportunistic routing for wireless ad hoc networks. IEEE/ACM Trans Netw
Trzcinski T, Rokita P (2017) Predicting popularity of online videos using support vector regression. IEEE Trans Multimedia 19(11):2561–2570
Tang F, Fadlullah ZM, Mao B, Kato N (2018) An intelligent traffic load prediction based adaptive channel assignment algorithm in SDN-IoT: a deep learning approach, IEEE Internet Things J
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Deepthi, J.V.N.R., Khan, A.K., Acharjee, T. (2024). Reinforcement Learning Based Spectrum Sensing and Resource Allocation in WSN-IoT Smart Applications. In: Malhotra, R., Sumalatha, L., Yassin, S.M.W., Patgiri, R., Muppalaneni, N.B. (eds) High Performance Computing, Smart Devices and Networks. CHSN 2022. Lecture Notes in Electrical Engineering, vol 1087. Springer, Singapore. https://doi.org/10.1007/978-981-99-6690-5_8
Download citation
DOI: https://doi.org/10.1007/978-981-99-6690-5_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-6689-9
Online ISBN: 978-981-99-6690-5
eBook Packages: Computer ScienceComputer Science (R0)