Fuzzy Reinforcement Learning Algorithm for Efficient Task Scheduling in Fog-Cloud IoT-Based Systems
Abstract
In recent years, the number of IoT applications that require low latency has increased greatly. Traditional cloud servers cannot handle these applications due to strict latency requirements. Edge technologies like fog computing meet these applications’ latency needs. Computing infrastructure is near end-user devices in fog-cloud environments. There are numerous traditional methods for scheduling IoT applications on heterogeneous and distributed fog-cloud nodes in these fields. Research in machine learning and its applications in many fields has grown tremendously in recent years. Machine learning algorithms such as reinforcement learning (RL) can be used to learn and make decisions based on reward signals from the environment. The purpose of this paper is to present a Task Scheduling algorithm based on Fuzzy Reinforcement Learning (TSFRL) to allocate fog-cloud computing resources so as to meet the deadlines of IoT requests. The scheduling problem is initially formulated to reduce response times, costs, and energy consumption. Fuzzy logic is then used to prioritize tasks. Fog nodes and cloud nodes employ the on-policy reinforcement learning methodology to prioritize delay-sensitive tasks with a higher priority and delay-tolerant ones with a lower priority. The suggested strategy outperforms existing algorithms in response time, cost, energy usage, and percentage of deadlines met.
References
[1]
Allaoui T, Gasmi K, and Ezzedine T Reinforcement learning based task offloading of IoT applications in fog computing: algorithms and optimization techniques Cluster Comput. 2024 27 10299-10324
[2]
Bachiega J, Costa B, Carvalho LR, Rosa MJF, and Araujo A Computational resource allocation in fog computing: a comprehensive survey ACM Comput. Surv. 2023 55 14s 1-31
[3]
Jalali Khalil Abadi Z, Mansouri N, and Khalouie M Task scheduling in fog environment — Challenges, tools & methodologies: A review Comput. Sci. Rev. 2023 48 100550
[4]
Zolghadri M, Asghari P, Dashti SE, and Hedayati A Resource allocation in Fog-Cloud Environments: State of the art J. Netw. Comput. Appl. 2024 227 103891
[5]
Hou H, Jawaddi SNA, and Ismail A Energy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review Future Gener. Comput. Syst. 2023 151 214-231
[6]
Cao S et al. Reinforcement learning based tasks offloading in vehicular edge computing networks Comput. Netw. 2023 234 109894
[7]
Taheri-abed S, Eftekhari Moghadam AM, and Rezvani MH Machine learning-based computation offloading in edge and fog: a systematic review Cluster Comput. 2023 26 5 3113-3144
[8]
Archana R Multilevel scheduling mechanism for a stochastic fog computing environment using the HIRO model and RNN Sustain. Comput.: Inf. Syst. 2023 39 100887
[9]
Ghafari R and Mansouri N E-AVOA-TS: Enhanced African vultures optimization algorithm-based task scheduling strategy for fog–cloud computing Sustain. Comput.: Inf. Syst. 2023 40 100918
[10]
Jamil B, Ijaz H, Shojafar M, Munir K, and Buyya R Resource allocation and task scheduling in fog computing and internet of everything environments: A taxonomy, review, and future directions ACM Comput. Surv. (CSUR) 2022 54 11s 1-38
[11]
Bonomi, F., Milito, R., Zhu, J., Addepalli, S.: Fog computing and its role in the internet of things. In: Proceedings of the first edition of the MCC workshop on Mobile cloud computing, pp. 13–16. (2012)
[12]
Hussain, M, Nabi, S., Hussain, M.: RAPTS: resource aware prioritized task scheduling technique in heterogeneous fog computing environment. Cluster Comput. 1–25 (2024)
[13]
Fahimullah M, Ahvar S, Agarwal M, and Trocan M Machine learning-based solutions for resource management in fog computing Multimed. Tools Appl. 2023 83 8 1-27
[14]
Iftikhar S et al. HunterPlus: AI based energy-efficient task scheduling for cloud–fog computing environments Internet of Things 2023 21 100667
[15]
Ghafari R and Mansouri N An efficient task scheduling in fog computing using improved artificial hummingbird algorithm J . Comput. Sci. 2023 74 102152
[16]
Ramezani Shahidani F, Ghasemi A, Toroghi Haghighat A, and Keshavarzi A Task scheduling in edge-fog-cloud architecture: a multi-objective load balancing approach using reinforcement learning algorithm Computing 2023 105 6 1337-1359
[17]
Hoseiny F, Azizi S, Shojafar M, and Tafazolli R Joint QoS-aware and cost-efficient task scheduling for fog-cloud resources in a volunteer computing system ACM Trans. Int. Technol. (TOIT) 2021 21 4 1-21
[18]
Alizadeh MR, Khajehvand V, Rahmani AM, and Akbari E Task scheduling approaches in fog computing: A systematic review Int. J. Commun Syst 2020 33 16 e4583
[19]
Guevara, J. C., Torres, R. da S., Bittencourt, L. F., da Fonseca, N. L. S.: QoS-aware task scheduling based on reinforcement learning for the cloud-fog continuum. In: GLOBECOM 2022–2022 IEEE Global Communications Conference, pp. 2328–2333. (2022)
[20]
Ahmad S, Shakeel I, Mehfuz S, and Ahmad J Deep learning models for cloud, edge, fog, and IoT computing paradigms: Survey, recent advances, and future directions Comput. Sci. Rev. 2023 49 100568
[21]
Gasmi R, Hammoudi S, Lamri M, and Harous S Recent Reinforcement Learning and Blockchain Based Security Solutions for Internet of Things: Survey Wireless Pers. Commun. 2023 132 2 1307-1345
[22]
Sutton RS and Barto AG Reinforcement learning: An introduction 2018 MIT Press
[23]
Hortelano D et al. A comprehensive survey on reinforcement-learning-based computation offloading techniques in Edge Computing Systems J. Netw. Comput. Appl. 2023 216 103669
[24]
Zabihi Z, Eftekhari Moghadam AM, and Rezvani MH Reinforcement learning methods for computation offloading: a systematic review ACM Comput. Surv. 2023 56 1 1-41
[25]
Al-Hamadani MNA, Fadhel MA, Alzubaidi L, and Harangi B Reinforcement learning algorithms and applications in healthcare and robotics: a comprehensive and systematic review Sensors 2024 24 8 2461
[26]
Thakur, R., Sikka, G., Bansal, U., Giri, J., Mallik, S.: Deadline-aware and energy efficient IoT task scheduling using fuzzy logic in fog computing. Multimed. Tools Appl. 1–28 (2024).
[27]
Zadeh L Fuzzy sets Inform Control 1965 8 338-353
[28]
Al-Araji ZJ, Ahmad SSS, Kausar N, Anis FG, Ozbilge E, and Cagin T Fuzzy theory in fog computing: review, taxonomy, and open issues IEEE Access 2022 10 126931-126956
[29]
Abdullah L Fuzzy multi criteria decision making and its applications: a brief review of category Procedia Soc. Behav. Sci. 2013 97 131-136
[30]
Jalali Khalil Abadi Z and Mansouri N A comprehensive survey on scheduling algorithms using fuzzy systems in distributed environments Artif. Intell. Rev. 2024 57 1 4
[31]
Azizi S, Shojafar M, Abawajy J, and Buyya R Deadline-aware and energy-efficient IoT task scheduling in fog computing systems: A semi-greedy approach J. Netw. Comput. Appl. 2022 201 103333
[32]
Vijayalakshmi V and Saravanan M Reinforcement learning-based multi-objective energy-efficient task scheduling in fog-cloud industrial IoT-based systems Soft. Comput. 2023 27 23 17473-17491
[33]
Mousavi S, Mood SE, Souri A, and Javidi MM Directed search: a new operator in NSGA-II for task scheduling in IoT based on cloud-fog computing IEEE Trans. Cloud Comput. 2022 11 2 2144-2157
[34]
Yadav AM, Tripathi KN, and Sharma SC A bi-objective task scheduling approach in fog computing using hybrid fireworks algorithm J . Supercomput. 2022 78 3 4236-4260
[35]
Raju MR and Mothku SK Delay and energy aware task scheduling mechanism for fog-enabled IoT applications: A reinforcement learning approach Comput. Netw. 2023 224 109603
[36]
Abdel-Basset M, Mohamed R, Elhoseny M, Bashir AK, Jolfaei A, and Kumar N Energy-aware marine predators algorithm for task scheduling in IoT-based fog computing applications IEEE Trans. Industr. Inf. 2020 17 7 5068-5076
[37]
Hussain SM and Begh GR Hybrid heuristic algorithm for cost-efficient QoS aware task scheduling in fog–cloud environment J. Comput. Sci. 2022 64 101828
[38]
Kumar MS and Karri GR Eeoa: cost and energy efficient task scheduling in a cloud-fog framework Sensors 2023 23 5 2445
[39]
Zhao, W., Stankovic, J. A.: Performance analysis of FCFS and improved FCFS scheduling algorithms for dynamic real-time computer systems. In: 1989 Real-Time Systems Symposium, pp. 156–157. (1989)
[40]
Stankovic JA, Spuri M, Ramamritham K, and Buttazzo G Deadline scheduling for real-time systems: EDF and related algorithms 460 1998 Boston Springer Science & Business Media
[41]
Aladwani, T.: Types of task scheduling algorithms in cloud computing environment. In: Scheduling problems-New applications and trends. (2020).
[42]
Er-raji, N., Benabbou, F., Eddaoui, A.: A new task scheduling algorithm for improving tasks execution time in cloud computing. In: Innovations in Smart Cities and Applications: Proceedings of the 2nd Mediterranean Symposium on Smart City Applications 2, pp. 298–304. (2018)
[43]
Chen X et al. A woa-based optimization approach for task scheduling in cloud computing systems IEEE Syst. J. 2020 14 3 3117-3128
[44]
Zhou Z, Li F, Zhu H, Xie H, Abawajy JH, and Chowdhury MU An improved genetic algorithm using greedy strategy toward task scheduling optimization in cloud environments Neural Comput. Appl. 2020 32 1531-1541
[45]
Hoseiny, F., Azizi, S., Shojafar, M., Ahmadiazar, F., Tafazolli, R.: PGA: a priority-aware genetic algorithm for task scheduling in heterogeneous fog-cloud computing. In: IEEE INFOCOM 2021-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pp. 1–6. (2021)
[46]
Ghafari R and Mansouri N A novel energy-based task scheduling in fog computing environment: an improved artificial rabbits optimization approach Cluster Comput. 2024 27 8413-8458
Index Terms
- Fuzzy Reinforcement Learning Algorithm for Efficient Task Scheduling in Fog-Cloud IoT-Based Systems
Index terms have been assigned to the content through auto-classification.
Recommendations
Deep reinforcement learning-based scheduling in distributed systems: a critical review
AbstractMany fields of research use parallelized and distributed computing environments, including astronomy, earth science, and bioinformatics. Due to an increase in client requests, service providers face various challenges, such as task scheduling, ...
Reinforcement learning based task offloading of IoT applications in fog computing: algorithms and optimization techniques
AbstractIn recent years, fog computing has become a promising technology that supports computationally intensive and time-sensitive applications, especially when dealing with Internet of Things (IoT) devices with limited processing capability. In this ...
Fuzzy Reinforcement Learning for energy efficient task offloading in Vehicular Fog Computing
AbstractVehicular Fog Computing (VFC) has been envisioned as a potential fog computing paradigm which aims to offload delay sensitive tasks to mobile fog vehicles instead of remote cloud in order to facilitate computational demands of smart ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Nature B.V. 2024.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 23 September 2024
Accepted: 10 September 2024
Received: 16 May 2024
Author Tags
Author Tag
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025