Deep FS: A Deep Learning Approach for Surface Solar Radiation
<p>Proposed Model.</p> "> Figure 2
<p>Time series analysis for a specific time.</p> "> Figure 3
<p>Spectral analysis.</p> "> Figure 4
<p>Regression analysis.</p> "> Figure 5
<p>Time series visualization for different timestamps.</p> "> Figure 6
<p>Surface exposure prediction using CNN-LSTM models.</p> "> Figure 7
<p>Surface exposure prediction using different models.</p> "> Figure 8
<p>The CNN-GRU model’s time series visualization for different timestamps.</p> "> Figure 9
<p>The CNN-LSTM model’s time series visualization for different timestamps.</p> "> Figure 10
<p>The CNN-LSTM model’s training history and prediction success.</p> "> Figure 11
<p>CNN-GRU model’s training history and prediction success.</p> "> Figure 12
<p>CNN-GRU and CNN-LSTM ROC curves.</p> ">
Abstract
:1. Introduction
2. Related Work
2.1. Research Gaps
- Current deep learning models lack effective feature selection mechanisms, potentially including redundant or less relevant features that may impact prediction accuracy.
- The integration of multiple deep learning architectures for solar exposure prediction remains largely unexplored, especially in combining spatial and temporal feature extraction.
- Limited research exists on adaptable models that can handle varying environmental conditions and seasonal changes while maintaining prediction accuracy.
2.2. Rsearch Contributions
- Developing a hybrid CNN–LSTM/GRU architecture (Deep-FS feature selection methodology) that effectively combines spatial and temporal feature extraction capabilities, improving prediction accuracy over single-architecture approaches.
- Demonstrates improved performance over traditional approaches through comprehensive evaluation using the RMSE, RRMSE, R2, and MAE metrics.
- Demonstrates superior performance over traditional statistical and machine learning approaches, achieving 96% prediction accuracy with enhanced generalizability.
3. Proposed Method
3.1. Data Acquisition
3.2. Data Analysis and Preprocessing
3.3. Feature Extraction
3.4. Feature Selection and Visualization
3.5. Model Design and Prediction
- The solar data is acquired from both datasets. Let X represent the data points in the dataset.
- Data are then normalized for a specific range using the mean and standard deviation.
- Relevant features are extracted from the features mentioned in Table 3 using the feature extraction process:
- The data points are normalized.
- Convolution is applied to extract the local features.
- The RelU Activation function, along with pooling and flattening, is applied for capturing essential features.
- CNN-LSTM and CNN-GRU models are designed.LSTM:GRU:
- W: Filter;
- b: bias;
- : ReLU Activation.
The LSTM Cell Process is defined as- : Forget Gate;
- : Input Gate;
- h: Hidden State;
- : Candidate Cell State;
- W: Weight.
- Train the model and optimize the loss function.
- Evaluate the performance with different performance metrics RMSE, RRMSE, MAE, and R2 as follows.
- Perform a comparative analysis with traditional approaches for the validation of the proposed method.
3.6. Elaboration on Model Selection
3.6.1. Temporal Dependency Handling
3.6.2. Variable Sequence Length
3.6.3. Memory Management
3.7. Advantages over Specific Algorithms
4. Experimental Results
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Li, P.; Zhou, K.; Lu, X.; Yang, S. A hybrid deep learning model for short-term PV power forecasting. Appl. Energy 2020, 259, 114216. [Google Scholar] [CrossRef]
- Mayer, M.; Gróf, G. Extensive comparison of physical models for photovoltaic power forecasting. Appl. Energy 2021, 283, 116239. [Google Scholar] [CrossRef]
- Wang, K.; Qi, X.; Liu, H. A comparison of day-ahead photovoltaic power forecasting models based on deep learning neural network. Appl. Energy 2019, 251, 113315. [Google Scholar] [CrossRef]
- Colak, I.; Yesilbudak, M.; Genc, N.; Bayindir, R. Multi-period prediction of solar radiation using ARMA and ARIMA models. In Proceedings of the IEEE 14th International Conference on Machine Learning and Applications (ICMLA), Miami, FL, USA, 9–11 December 2015. [Google Scholar]
- Alharbi, F.; Csala, D. A Seasonal Autoregressive Integrated Moving Average with Exogenous Factors (SARIMAX) Forecasting Model-Based Time Series Approach. Inventions 2022, 7, 94. [Google Scholar] [CrossRef]
- Lim, S.C.; Huh, J.H.; Hong, S.H.; Park, C.Y.; Kim, J.C. Solar Power Forecasting Using CNN-LSTM Hybrid Model. Energies 2022, 15, 8233. [Google Scholar] [CrossRef]
- Brahma, B.; Wadhvani, R. Solar irradiance forecasting based on deep learning methodologies and multi-site data. Symmetry 2020, 12, 1830. [Google Scholar] [CrossRef]
- Jalali, S.; Ahmadian, S.; Kavousi-Fard, A.; Khosravi, A.; Nahavandi, S. Automated deep CNN-LSTM architecture design for solar irradiance forecasting. IEEE Trans. Syst. Man Cybern. 2021, 52, 54–65. [Google Scholar] [CrossRef]
- Zang, H.; Liu, L.; Sun, L.; Cheng, L.; Wei, Z.; Sun, G. Short-term global horizontal irradiance forecasting based on a hybrid CNN-LSTM model with spatiotemporal correlations. Renew. Energy 2020, 160, 26–41. [Google Scholar] [CrossRef]
- Jebli, I.; Belouadha, F.; Kabbaj, M.; Tilioua, A. Prediction of solar energy guided by pearson correlation using machine learning. Energy 2021, 224, 120109. [Google Scholar] [CrossRef]
- Husein, M.; Chung, I. Day-ahead solar irradiance forecasting for microgrids using a long short-term memory recurrent neural network: A deep learning approach. Energies 2019, 12, 1856. [Google Scholar] [CrossRef]
- Alzahrani, A.; Shamsi, P.; Dagli, C.; Ferdowsi, M. Solar Irradiance Forecasting Using Deep Neural Networks. Procedia Comput. Sci. 2017, 114, 304–313. [Google Scholar] [CrossRef]
- Dhilip Kumar, R.; Prakash, K.; Sundari, P.A.; Sathya, S. A Hybrid Machine Learning Model for Solar Power Forecasting. E3S Web Conf. 2023, 387, 04003. [Google Scholar] [CrossRef]
- Sarmas, E.; Dimitropoulos, N.; Marinakis, V.; Mylona, Z.; Doukas, H. Transfer learning strategies for solar power forecasting under data scarcity. Sci. Rep. 2022, 12, 14643. [Google Scholar] [CrossRef] [PubMed]
- Chatterjee, S.; Byun, Y.C. A Synthetic Data Generation Technique for Enhancement of Prediction Accuracy of Electric Vehicles Demand. Sensors 2023, 23, 594. [Google Scholar] [CrossRef] [PubMed]
- Tan, L.; Kang, R.; Xia, J.; Wang, Y. Application of multi-source data fusion on intelligent prediction of photovoltaic power. Sol. Energy 2024, 277, 112706. [Google Scholar] [CrossRef]
- Hou, X.; Ju, C.; Wang, B. Prediction of solar irradiance using convolutional neural network and attention mechanism-based long short-term memory network based on similar day analysis and an attention mechanism. Heliyon 2023, 9, e21484. [Google Scholar] [CrossRef]
- Ozbek, A.; Yildirim, A.; Bilgili, M. Deep learning approach for one-hour ahead forecasting of energy production in a solar-PV plant. Energy Sources Part A Recover. Util. Environ. Eff. 2021, 44, 10465–10480. [Google Scholar] [CrossRef]
- Neshat, M.; Nezhad, M.M.; Mirjalili, S.; Garcia, D.A.; Dahlquist, E.; Gandomi, A.H. Short-term solar radiation forecasting using hybrid deep residual learning and gated LSTM recurrent network with differential covariance matrix adaptation evolution strategy. Energy 2023, 278, 127701. [Google Scholar] [CrossRef]
- Park, S.; Kim, Y.; Ferrier, N.; Collis, S.; Sankaran, R.; Beckman, P. Prediction of Solar Irradiance and Photovoltaic Solar Energy Product Based on Cloud Coverage Estimation Using Machine Learning Methods. Atmosphere 2021, 12, 395. [Google Scholar] [CrossRef]
- Zhang, L.; Wilson, R.; Sumner, M.; Wu, Y. Advanced multimodal fusion method for very short-term solar irradiance forecasting using sky images and meteorological data: A gate and transformer mechanism approach. Renew. Energy J. 2023, 216, 118952. [Google Scholar] [CrossRef]
- Yuzer, E.O.; Bozkurt, A. Deep learning model for regional solar radiation estimation using satellite images. Ain Shams Eng. J. 2020, 14, 102057. [Google Scholar] [CrossRef]
- Mathiesen, P.; Collier, C.; Kleissl, J. A high-resolution, cloud-assimilating numerical weather prediction model for solar irradiance forecasting. Sol. Energy J. 2013, 92, 47–61. [Google Scholar] [CrossRef]
- Hedar, A.R.; Almaraashi, M.; Abdel-Hakim, A.; Abdulrahim, M. Hybrid Machine Learning for Solar Radiation Prediction in Reduced Feature Spaces. Energies 2021, 14, 7970. [Google Scholar] [CrossRef]
- Said, Y.A. AI-based solar energy forecasting for smart grid integration. Neural Comput. Appl. 2023, 35, 8625–8634. [Google Scholar] [CrossRef]
- Huang, C.; Wang, L.; Lai, L.L. Data-Driven Short-Term Solar Irradiance Forecasting Based on Information of Neighboring Sites. IEEE Trans. Ind. Electron. 2019, 66, 9918–9927. [Google Scholar] [CrossRef]
- Yu, Y.; Si, X.; Hu, C.; Zhang, J. A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput. 2019, 31, 1235–1270. [Google Scholar] [CrossRef]
- Sherstinsky, A. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Phys. D Nonlinear Phenom. 2020, 404, 132306. [Google Scholar] [CrossRef]
No. | Title | Authors | Year | Methodology | Key Findings |
---|---|---|---|---|---|
1 | Solar Irradiance Forecasting | Ahmad et al. [12] | 2017 | CNNs with data augmentation | Achieved high accuracy in short-term solar radiation prediction |
2 | A Hybrid Machine Learning Model | Dhilip et al. [13] | 2023 | CNN-RNN hybrid model | Combined temporal and spatial features for improved predictions |
3 | Transfer learning strategies | Saramas et al. [14] | 2022 | Transfer learning with pre-trained models | Enhanced model performance with limited training data |
4 | A Synthetic Data Generation Technique | Byun et al. [15] | 2022 | Synthetic data generation and CNNs | Addressed data scarcity issues, improving prediction reliability |
5 | Application of multi-source data fusion | Ling et al. [16] | 2024 | Integration of satellite and ground data | Significantly improved accuracy by combining multiple data sources |
6 | Prediction of solar irradiance using convolutional neural network | Chao et al. [17] | 2023 | CNNs | Focused on high-resolution imagery to capture fine details in solar exposure |
7 | Deep learning approach for one-hour ahead forecasting | Patel et al. [18] | 2021 | CNNs and regression models | Improved solar panel efficiency through accurate yield estimation |
8 | Short-term solar radiation forecasting | Mehdi et al. [19] | 2023 | Hybrid CNN-RNN | Developed robust models integrating spatial-temporal data |
9 | Prediction of Solar Irradiance and Photovoltaic Solar Energy | Yonghua et al. [20] | 2021 | CNNs | Achieved high accuracy in diverse weather conditions |
10 | Advanced multimodal fusion method | Lwengo et al. [21] | 2023 | Transfer learning and data augmentation | Enhanced model generalizability across different regions |
11 | Deep learning model for regional solar radiation | Ersan et al. [22] | 2020 | RNNs with feature engineering | Improved prediction accuracy through advanced feature extraction |
12 | A high-resolution, cloud-assimilating numerical weather prediction model | Patrick et al. [23] | 2013 | CNNs with high-resolution imagery | Focused on capturing small-scale variations in solar exposure |
13 | Hybrid Machine Learning for Solar Radiation Prediction | Heydar et al. [24] | 2021 | CNN-RNN hybrid models | Combined strengths of CNNs and RNNs for superior predictions |
14 | AI-based solar energy forecasting for smart grid integration | Said et al. [25] | 2023 | AI and machine learning techniques | Leveraged AI to enhance predictive accuracy and model robustness |
15 | Data-Driven Short-Term Solar Irradiance Forecasting | Huang et al. [26] | 2019 | Data-driven approaches with deep learning | Achieved significant improvements in prediction reliability and accuracy |
Ch# | Name | Wavelength Range (nm) | Spatial Res. (km) | Spectral Res. (nm) | Description |
---|---|---|---|---|---|
Ch#1 | UV | 100–400 | 10 | 1 | Ultraviolet (UV) radiation measurement is typically used for ozone monitoring or atmospheric composition studies |
Ch#2 | Visible | 400–700 | 10 | 1 | Visible light measurement is used for surface reflectance, vegetation monitoring, and cloud detection |
Ch#3 | NIR | 700–1100 | 10 | 1 | Near-infrared (NIR) measurement is valuable for vegetation health monitoring, land cover classification, and moisture content |
Ch#4 | SWIR | 1100–2500 | 10 | 1 | Shortwave infrared (SWIR) measurement is useful for geological mapping, vegetation analysis, and soil moisture estimation |
Ch#5 | MWIR | 2500–5000 | 10 | 1 | Midwave infrared (MWIR) measurement is often utilized for temperature mapping, fire detection, and atmospheric profiling |
Ch#6 | LWIR | 8000–12,000 | 10 | 1 | Longwave infrared (LWIR) measurement is critical for cloud characterization, sea surface temperature monitoring, and more |
Ch#7 | CO2 | 400–750 | 10 | 0.1 | Carbon dioxide (CO2) absorption band is used for atmospheric composition studies and greenhouse gas monitoring |
Ch#8 | O3 | 250–350 | 10 | 0.1 | The ozone (O3) absorption band is crucial for stratospheric ozone monitoring and atmospheric chemistry research |
Ch#9 | CH4 | 1900–2100 | 10 | 0.1 | The methane (CH4) absorption band is significant for monitoring atmospheric methane concentrations and sources |
Ch#10 | H2O | 900–1000 | 10 | 0.1 | Water vapor (H2O) absorption band is important for studying humidity distribution, cloud formation, and precipitation |
Ch#11 | Aerosol | 500–750 | 10 | 0.1 | Aerosol optical depth measurement is essential for air quality monitoring, climate studies, and atmospheric modeling |
Ch#12 | Cloud | 800–1400 | 10 | 0.1 | Cloud properties are retrieved, including cloud top temperature, cloud phase, and cloud height |
Ch#13 | Albedo | 340–2400 | 10 | 1 | Surface albedo measurement is used for climate modeling, energy balance studies, and land surface characterization |
Ch#14 | Thermal | 8000–12,000 | 10 | 1 | Thermal infrared measurement is crucial for land surface temperature estimation, urban heat island detection, and more |
Ch#15 | Vegetation Index | N/A | 10 | N/A | Derived index combining multiple spectral bands is used to assess vegetation health and density |
Ch#16 | Land Surface Temperature | N/A | 10 | N/A | Derived temperature values represent the temperature of the Earth’s surface |
Feature Name | Description | Unit |
---|---|---|
Solar_Exposure | Total solar exposure measured in Earth’s atmosphere | Watts per square meter (W/m2) |
UV_Index | Ultraviolet index measuring UV radiation intensity | Unitless |
Visible_Light | Visible light intensity | Lux |
IR_Exposure | Infrared exposure | Watts per square meter (W/m2) |
Ozone_Concentration | The concentration of ozone in the atmosphere | Dobson units |
Water_Vapor_Concentration | Concentration of water vapor in the atmosphere | Grams per cubic meter (g/m3) |
Surface_Temperature | Temperature of the Earth’s surface | Celsius (°C) |
Atmospheric_Pressure | The pressure exerted by the atmosphere | Hectopascals (hPa) |
Solar_Activity_Index | Index measuring solar activity and sunspots | Unitless |
Solar_Flux | Solar flux measurements | Watts per square meter (W/m2) |
Aerosol_Optical_Depth | Measure of aerosol particles in the atmosphere | Unitless |
Cloud_Cover | Percentage of sky covered by clouds | Percent (%) |
Wind_Speed | Speed of wind at Earth’s surface | Meters per second (m/s) |
Precipitation_Rate | Rate of precipitation (rainfall or snowfall) | Millimeters per hour (mm/hr) |
Sea_Surface_Temperature | Temperature of the sea surface | Celsius (°C) |
Ocean_Current_Speed | Speed of ocean currents | Meters per second (m/s) |
Chlorophyll_Concentration | Concentration of chlorophyll in water | Milligrams per cubic meter (mg/m3) |
Photosynthetically_Active _Radiation | Solar radiation used by plants | Micromoles per square meter per second (µmol/m2/s) |
Phytoplankton _Concentration | Concentration of phytoplankton in water | Cells per liter (cells/L) |
Fish_Population_Density | Density of fish population in water | Fish per cubic meter (fish/m3) |
Algae_Bloom_Area | Area covered by algae blooms | Square kilometers (km2) |
Primary_Production_Rate | Rate of primary production in marine ecosystems | Grams of carbon per square meter per year (gC/m2/yr) |
Temperature_Anomaly | Anomaly in surface temperature compared to baseline | Celsius (°C) |
Sea_Level_Rise | Rise in sea level | Millimeters (mm) |
Glacier_Mass_Balance | Change in mass of glaciers | Meters water equivalent (m w.e.) |
Ocean_Acidification | Decrease in pH levels of oceans | pH units |
Online_Education _Enrollment | Enrollment in online education courses | Millions |
Remote_Work_Practices | Adoption of remote work practices | Percentage (%) |
Telemedicine_Usage | Usage of telemedicine services | Consultations |
Virtual_Reality_Adoption | Adoption of virtual reality technologies | Percentage (%) |
Space_Exploration_Budget | Budget allocated to space exploration | Billion USD |
Mars_Colonization_Projects | Projects related to the colonization of Mars | Count |
AI_Satellite_Launches | Satellite launches for AI applications | Count |
Climate_Change _Adaptation_Projects | Projects addressing climate change adaptation | Count |
Renewable_Energy _Investments | Investments in renewable energy projects | Billion USD |
Model | Structure | Value |
---|---|---|
CNN-LSTM | Input | 6 × 6 × K × F |
Convolution | 4 × 4 Filter | |
8 Filters | ||
Zero Padding | ||
Tanh Activation | ||
Max Pooling | 4 × 4 Filter | |
2 Strides | ||
LSTM | 16 Nodes | |
Tanh Activation | ||
Output | N × 1 | |
MSE | ||
CNN-GRU | Input | 6 × 6 × K × F |
Convolution | 4 × 4 Filter | |
8 Filters | ||
Zero Padding | ||
Tanh Activation | ||
Max Pooling | 4 × 4 Filter | |
2 Strides | ||
GRU | 16 Nodes | |
Tanh Activation | ||
Output | N × 1 | |
MSE |
Model | Method | RMSE | RRMSE | R2 | MAE |
---|---|---|---|---|---|
Convolutional Neural Network (Long Short-Term Memory) | Full Features | 0.24982 | 0.12806 | 0.9196 | 0.08241 |
Fisher Score | 0.33946 | 0.29365 | 0.7468 | 0.11524 | |
Recursive Feature Elimination (RFE) | 0.12323 | 0.06604 | 0.88034 | 0.11519 | |
Random Forest Importance | 0.38323 | 0.3755 | 0.99097 | 0.14686 | |
Deep Feature Selection (LSTM) | 0.43298 | 0.35714 | 0.75455 | 0.09747 | |
Deep Feature Selection (GRU) | 0.17336 | 0.13292 | 0.85743 | 0.03005 | |
Convolutional Neural Network (Gated Recurrent Unit) | Full Features | 0.27278 | 0.21126 | 0.88356 | 0.07441 |
Fisher Score | 0.1558 | 0.12057 | 0.80991 | 0.02427 | |
Recursive Feature Elimination (RFE) | 0.28243 | 0.15821 | 0.7599 | 0.07977 | |
Random Forest Importance | 0.30569 | 0.19197 | 0.71394 | 0.09345 | |
Deep Feature Selection (LSTM) | 0.34302 | 0.29305 | 0.71952 | 0.05766 | |
Deep Feature Selection (GRU) | 0.47955 | 0.24397 | 0.94252 | 0.22997 |
Method | Model | Performance Parameters | |||
---|---|---|---|---|---|
RMSE | RRMSE | R2 | MAE | ||
Deep FS (Long Short-Term Memory) | Artificial Neural Network | 0.249816 | 0.128064 | 0.919598 | 0.062408 |
Convolutional Neural Network | 0.123233 | 0.066035 | 0.880335 | 0.015186 | |
Long Short-Term Memory | 0.432977 | 0.357142 | 0.754547 | 0.187469 | |
Gated Recurrent Unit | 0.272778 | 0.211255 | 0.883556 | 0.074408 | |
CNN (LSTM) | 0.082428 | 0.018207 | 0.759902 | 0.049766 | |
CNN (GRU) | 0.343018 | 0.293046 | 0.919515 | 0.117661 | |
Deep FS (Gated Recurrent Unit) | Artificial Neural Network | 0.339463 | 0.293649 | 0.746798 | 0.115235 |
Convolutional Neural Network | 0.383229 | 0.37552 | 0.960973 | 0.146864 | |
Long Short-Term Memory | 0.173362 | 0.132921 | 0.857427 | 0.030054 | |
Gated Recurrent Unit | 0.155798 | 0.120573 | 0.809909 | 0.024273 | |
CNN (LSTM) | 0.125694 | 0.101969 | 0.713935 | 0.013449 | |
CNN (GRU) | 0.479554 | 0.243969 | 0.962519 | 0.229972 |
Model | RMSE | RRMSE | MAE | R2 |
---|---|---|---|---|
ARIMA | 0.3543 | 0.1104 | 0.2544 | 0.8511 |
SARIMA | 0.3234 | 0.0823 | 0.2234 | 0.8834 |
CNN (LSTM) | 0.2516 | 0.0723 | 0.1812 | 0.9567 |
CNN (GRU) | 0.2201 | 0.0611 | 0.1522 | 0.9233 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kihtir, F.; Oztoprak, K. Deep FS: A Deep Learning Approach for Surface Solar Radiation. Sensors 2024, 24, 8059. https://doi.org/10.3390/s24248059
Kihtir F, Oztoprak K. Deep FS: A Deep Learning Approach for Surface Solar Radiation. Sensors. 2024; 24(24):8059. https://doi.org/10.3390/s24248059
Chicago/Turabian StyleKihtir, Fatih, and Kasim Oztoprak. 2024. "Deep FS: A Deep Learning Approach for Surface Solar Radiation" Sensors 24, no. 24: 8059. https://doi.org/10.3390/s24248059
APA StyleKihtir, F., & Oztoprak, K. (2024). Deep FS: A Deep Learning Approach for Surface Solar Radiation. Sensors, 24(24), 8059. https://doi.org/10.3390/s24248059