Comparing and Optimizing Four Machine Learning Approaches to Radar-Based Quantitative Precipitation Estimation
<p>Distribution of automatic weather stations (blue dots) and the Qingpu radar (red triangle) in Shanghai.</p> "> Figure 2
<p>Schematic diagram of the 5 × 5 radar range bin data above the automatic weather station.</p> "> Figure 3
<p>Workflow diagram for the relationship between the Z and R model, SVM, GBDT, RFR, and the KAN deep learning model for single-variable and multivariable precipitation estimation.</p> "> Figure 4
<p>Single-variable KAN deep learning neural network architecture.</p> "> Figure 5
<p>Multivariable KAN deep learning neural network architecture.</p> "> Figure 6
<p>Comparison of the estimation effects of two Z-R relationships.</p> "> Figure 7
<p>Scatter density plots of estimated vs. actual precipitation for five single-variable models: (<b>a</b>) Z = 270.81 R<sup>1.09</sup>; (<b>b</b>) SVM; (<b>c</b>) RF; (<b>d</b>) GBDT; and the (<b>e</b>) KAN deep learning method. The black solid line represents the ideal scenario where estimated values are perfectly aligned with observed values (<span class="html-italic">y = x</span>), while the red solid line indicates the actual relationship between estimated and observed values, highlighting the bias between them.</p> "> Figure 8
<p>Map of radar reflectivity and spatial distribution of univariate precipitation estimates using five different models at 06:00 UTC on 24 June 2024: (<b>a</b>) radar reflectivity; (<b>b</b>) Z = 270.81 R<sup>1.09</sup>; (<b>c</b>) Support Vector Machine model; (<b>d</b>) Random Forest model; (<b>e</b>) Gradient Boosting Decision Tree model; and (<b>f</b>) KAN deep learning model.</p> "> Figure 8 Cont.
<p>Map of radar reflectivity and spatial distribution of univariate precipitation estimates using five different models at 06:00 UTC on 24 June 2024: (<b>a</b>) radar reflectivity; (<b>b</b>) Z = 270.81 R<sup>1.09</sup>; (<b>c</b>) Support Vector Machine model; (<b>d</b>) Random Forest model; (<b>e</b>) Gradient Boosting Decision Tree model; and (<b>f</b>) KAN deep learning model.</p> "> Figure 9
<p>Scatter density plots of estimated vs. actual precipitation for four multivariable models: (<b>a</b>) SVM (multivariable); (<b>b</b>) GBDT (multivariable); (<b>c</b>) RF (multivariable); and (<b>d</b>) KAN deep learning method (multivariable). The red solid line represents the ideal scenario where estimated values are perfectly aligned with observed values (<span class="html-italic">y = x</span>), while the black solid line indicates the actual relationship between estimated and observed values, highlighting the bias between them.</p> "> Figure 10
<p>Map of radar reflectivity and spatial distribution of multivariable precipitation estimates using four different models at 06:00 UTC on June 24, 2024: (<b>a</b>) radar reflectivity map; (<b>b</b>) Support Vector Machine model; (<b>c</b>) Random Forest model; (<b>d</b>) Gradient Boosting Decision Tree model; and (<b>e</b>) KAN deep learning model.</p> ">
Abstract
:1. Introduction
2. Methodology
2.1. Data Collection
2.2. Data Preprocessing
2.3. Model Selection and Optimization
2.3.1. Z-R Relationship
2.3.2. Support Vector Machine (SVM)
2.3.3. Gradient Boosting Decision Tree (GBDT)
2.3.4. Random Forest (RF)
2.3.5. KAN (Knowledge-Aware Network) Deep Learning Model
- The classification of precipitation processes by season organizes the year into four distinct periods: spring, occurring from March to May; summer from June to August; autumn from September to November; and winter, spanning from December to February of the subsequent year. The seasonal changes in KAN deep learning during these periods is discussed.
- Weather System Classification: Precipitation events are categorized by the weather system, including typhoon-induced precipitation (affected by typhoons), Meiyu precipitation (during the Meiyu period), frontal precipitation (occurring in spring and autumn with a duration of more than 3 h), and convective precipitation in summer (short-duration precipitation excluding typhoons and Meiyu). The differences in KAN deep learning under these weather systems are analyzed.
- Precipitation Intensity Classification: Based on the median hourly rainfall intensity, precipitation is divided into three categories—light rain is characterized by a precipitation rate that ranges from 0.1 to 1.5 mm per hour, moderate rain ranges from 1.6 to 6.9 mm/h, and heavy rain is classified as 7 to 14.9 mm/h. KAN deep learning for different precipitation intensities is investigated.
- Duration-Based Classification: Precipitation processes are classified by duration into short (1–6 h), medium (7–12 h), and long-duration events (greater than 12 h). The variation in KAN deep learning with precipitation duration is examined.
2.4. Evaluation Metrics
3. Results and Discussion
3.1. Comparison of the Estimation Effects of Two Z-R Relationships
3.2. Evaluation of Single-Variable Precipitation Estimation Reliability
3.3. Evaluation of Multivariable Precipitation Estimation Accuracy
3.4. Classification of KAN Deep Learning Performance Under Different Meteorological Conditions
4. Conclusions
- (1)
- Limitations of the classical Z-R Relationship: Z = 300 R1.4 significantly underestimated precipitation. In comparison, the locally fitted Z-R relationship Z = 270.81 R1.09 more accurately represented precipitation characteristics in the Shanghai region.
- (2)
- Superiority of Machine Learning Models: In single-variable input scenarios (using only radar reflectivity (Z)), the KAN deep learning model showed a significantly higher estimation reliability than GBDT, RF, SVM, and the Z-R relationship. All machine learning models outperformed the classical Z-R relationship, showing that deep learning models are more proficient at identifying the intricate nonlinear relationships between radar reflectivity and rainfall intensity.
- (3)
- Improved Performance with Multivariate Fusion Models: With multivariate inputs (integrating radar reflectivity, specific differential phase, correlation coefficient, echo-top height, differential reflectivity, and vertically integrated liquid water content), the performance of machine learning models improved significantly, with the KAN deep learning model showing the highest estimation reliability. The multivariate model effectively captured the multidimensional physical features influencing precipitation and their complex interrelations, greatly enhancing QPE reliability.
- (4)
- Advantages of the KAN Deep Learning Model: Whether using single-variable or multivariate inputs, the KAN deep learning model consistently demonstrated the highest precipitation estimation reliability. Its performance was particularly impressive when distinguishing between different seasons, weather systems, precipitation intensities, and phases. The KAN model combines the strengths of physics-driven and data-driven approaches, incorporating meteorological knowledge into the deep learning framework to improve QPE reliability.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Wu, Z.; Zhang, Y.; Zhang, L.; Zheng, H.; Huang, X. A Comparison of Convective and Stratiform cloud precipitation Microphysics of the Record-breaking Typhoon In-Fa (2021). Remote Sens. 2022, 14, 344. [Google Scholar] [CrossRef]
- Chen, J.-Y.; Chang, W.-Y.; Chang, P.-L. A Synthetic Quantitative Precipitation Estimation by Integrating S- and C-Band Dual-Polarization Radars over Northern Taiwan. Remote Sens. 2021, 13, 154. [Google Scholar] [CrossRef]
- Xie, Z.; Yang, H.; Lv, H.; Hu, Q. Seasonal Characteristics of Disdrometer-Observed Raindrop Size Distributions and Their Applications on Radar Calibration and Erosion Mechanism in a Semi-Arid Area of China. Remote Sens. 2020, 12, 262. [Google Scholar] [CrossRef]
- Huangfu, J.; Hu, Z.; Zheng, J.; Wang, L.; Zhu, Y. Study on Quantitative Precipitation Estimation by Polarimetric Radar Using Deep Learning. Adv. Atmos. Sci. 2024, 41, 1147–1160. [Google Scholar] [CrossRef]
- Song, L.; Chen, S.; Li, Y.; Qi, D.; Wu, J.; Chen, M.; Cao, W. The Quantile-Matching Approach to Improving Radar Quantitative Precipitation Estimation in South China. Remote Sens. 2021, 13, 4956. [Google Scholar] [CrossRef]
- Wijayarathne, D.; Boodoo, S.; Coulibaly, P.; Sills, D. Evaluation of Radar Quantitative Precipitation Estimates (QPEs) as an Input of Hydrological Models for Hydrometeorological Applications. J. Hydrometeorol. 2020, 21, 1847–1864. [Google Scholar] [CrossRef]
- Li, X.; Chen, Y.; Wang, H.; Zhang, Y. Assessment of GPM IMERG and radar quantitative precipitation estimation (QPE) products using dense rain gauge observations in the Guangdong-Hong Kong-Macao Greater Bay Area, China. Atmos. Res. 2020, 236, 104834. [Google Scholar] [CrossRef]
- Wang, G.; Liu, L.; Ding, Y. Improvement of radar quantitative precipitation estimation based on real-time adjustments to Z-R relationships and inverse distance weighting correction schemes. Adv. Atmos. Sci. 2012, 29, 575–584. [Google Scholar] [CrossRef]
- Eldardiry, H.; Habib, E. Examining the Robustness of a Spatial Bootstrap Regional Approach for Radar-Based Hourly Precipitation Frequency Analysis. Remote Sens. 2020, 12, 3767. [Google Scholar] [CrossRef]
- Alfieri, L.; Claps, P.; Laio, F. Time-dependent ZR relationships for estimating rainfall fields from radar measurements. Nat. Hazards Earth Syst. Sci. 2010, 10, 149–158. [Google Scholar] [CrossRef]
- Ryzhkov, A.; Zhang, P.; Bukovčić, P.; Zhang, J.; Cocks, S. Polarimetric Radar Quantitative Precipitation Estimation. Remote Sens. 2022, 14, 1695. [Google Scholar] [CrossRef]
- Zeng, Z.; Wang, D.; Chen, Y. An investigation of convective features and Z-R relationships for a local extreme precipitation event. Atmos. Res. 2021, 250, 105372. [Google Scholar] [CrossRef]
- Zeng, Y.; Yang, L.M.; Li, J.; Jiang, Y.; Tong, Z.; Li, X.; Li, H.; Liu, J.; Lu, X.; Zhou, Y. Seasonal variation of microphysical characteristics for different rainfall types in the Tianshan Mountains of China. Atmos. Res. 2023, 295, 107024. [Google Scholar] [CrossRef]
- Fang, X.; Shao, A.; Yue, X.; Liu, W. Statistics of the Z–R Relationship for Strong Convective Weather over the Yangtze–Huaihe River Basin and Its Application to Radar Reflectivity Data Assimilation for a Heavy Rain Event. J. Meteorol. Res. 2018, 32, 598–611. [Google Scholar] [CrossRef]
- Bournas, A.; Baltas, E. Determination of The relationship between Z and R through Spatial Analysis of X-Band Weather Radar and Rain Gauge Data. Hydrology 2022, 9, 137. [Google Scholar] [CrossRef]
- Ghada, W.; Bech, J.; Estrella, N.; Hamann, A.; Menzel, A. Weather Types Affect Rain Microstructure: Implications for Estimating Rain Rate. Remote Sens. 2020, 12, 3572. [Google Scholar] [CrossRef]
- Matrosov, S.Y. Distinguishing between Warm and Stratiform Rain Using Polarimetric Radar Measurements. Remote Sens. 2021, 13, 214. [Google Scholar] [CrossRef]
- Zeng, Y.; Yang, L.; Tong, Z.; Jiang, Y.; Chen, P.; Zhou, Y. Characteristics and Applications of Summer Season Raindrop Size Distributions Based on a PARSIVEL2 Disdrometer in the Western Tianshan Mountains (China). Remote Sens. 2022, 14, 3988. [Google Scholar] [CrossRef]
- Zeng, Y.; Yang, L.; Zhang, Z.; Tong, Z.; Li, J.; Liu, F.; Zhang, J.; Jiang, Y. Characteristics of Clouds and Raindrop Size Distribution in Xinjiang, Using Cloud Radar Datasets and a Disdrometer. Atmosphere 2020, 11, 1382. [Google Scholar] [CrossRef]
- Feng, L.; Liu, X.; Xiao, H.; Xiao, L.; Xia, F.; Hao, X.; Lu, H.; Zhang, C. Characteristics of Raindrop Size Distribution in Typhoon Nida (2016) before and after Landfall in Southern China from 2D Video Disdrometer Data. Adv. Meteorol. 2021, 2021, 9349738. [Google Scholar] [CrossRef]
- Li, X.; Chen, S.; Li, Z.; Huang, C.; Hu, J. Statistical Characteristics of Warm Season Raindrop Size Distribution in the Beibu Gulf, South China. Remote Sens. 2022, 14, 4752. [Google Scholar] [CrossRef]
- Sachidananda, M.; Zrnic, D.S. Differential Propagation Phase Shift and Rainfall Rate Estimation. Radio Sci. 1986, 21, 235–247. [Google Scholar] [CrossRef]
- Hazenberg, P.; Yu, N.; Boudevillain, B.; Delrieu, G.; Uijlenhoet, R. Scaling of raindrop size distributions and classification of radar reflectivity–rain rate relations in intense Mediterranean precipitation. J. Hydrol. 2011, 402, 179–192. [Google Scholar] [CrossRef]
- Liu, D.D.; Huang, C.; Lu, J.Y.; Wang, J.S. The hourly average solar wind velocity prediction based on support vector regression method: Solar wind velocity prediction based on SVR. Mon. Not. R. Astron. Soc. 2011, 413, 2877–2882. [Google Scholar] [CrossRef]
- Orellana-Alvear, J.; Célleri, R.; Rollenbeck, R.; Bendix, J. Optimization of X-Band Radar Rainfall Retrieval in the Southern Andes of Ecuador Using a Random Forest Model. Remote Sens. 2019, 11, 1632. [Google Scholar] [CrossRef]
- Yang, X.; Kuang, Q.; Zhang, W.; Zhang, G. A terrain-based weighted random forests method for radar quantitative precipitation estimation: A TWRF method for QPE. Meteorol. Appl. 2017, 24, 404–414. [Google Scholar] [CrossRef]
- Chen, W.; Hua, W.; Ge, M.; Su, F.; Liu, N.; Liu, Y.; Xiong, A. Severe Precipitation Recognition Using Attention-UNet of Multichannel Doppler Radar. Remote Sens. 2023, 15, 1111. [Google Scholar] [CrossRef]
- Zou, H.; Wu, S.; Tian, M. Radar Quantitative Precipitation Estimation Based on the Gated Recurrent Unit Neural Network and Echo-Top Data. Adv. Atmos. Sci. 2023, 40, 1043–1057. [Google Scholar] [CrossRef]
- Zhang, Y.; Bi, S.; Liu, L.; Chen, H.; Zhang, Y.; Shen, P.; Yang, F.; Wang, Y.; Zhang, Y.; Yao, S. Deep Learning for Polarimetric Radar Quantitative Precipitation Estimation during Landfalling Typhoons in South China. Remote Sens. 2021, 13, 3157. [Google Scholar] [CrossRef]
- Krause, J.M. A Simple Algorithm to Discriminate between Meteorological and Nonmeteorological Radar Echoes. J. Atmos. Ocean. Technol. 2016, 33, 1875–1885. [Google Scholar] [CrossRef]
- Zhang, C.; Wang, H.; Zeng, J.; Ma, L.; Guan, L. Short-Term Dynamic Radar Quantitative Precipitation Estimation Based on Wavelet Transform and Support Vector Machine. J. Meteorol. Res. 2020, 34, 413–426. [Google Scholar] [CrossRef]
- Ma, L.; Zhang, G.; Lu, E. Using the Gradient Boosting Decision Tree to Improve the Delineation of Hourly Rain Areas during the Summer from Advanced Himawari Imager Data. J. Hydrometeorol. 2018, 19, 761–776. [Google Scholar] [CrossRef]
- Liu, Z.; Wang, Y.; Vaidya, S.; Ruehle, F.; Halverson, J.; Soljačić, M.; Hou, T.Y.; Tegmark, M. KAN: Kolmogorov-Arnold Networks. arXiv 2024, arXiv:2404.19756. [Google Scholar]
Feature Name | Abbreviation | Uints | Description |
---|---|---|---|
Radar reflectivity | Z | dBZ | Size and density of particles |
Differential reflectivity | ZDR | dB | |
Specific differential phase shift | KDP | °/km | Rainfall rate and particle type |
Correlation coefficient | CC | Dimensionless | Particle uniformity and shape |
Vertical liquid water content | VIL | kg/m2 | Total liquid water content |
Echo-top height | ET | km | Maximum particle height |
Metric | Z-R Relationship | RF | GBDT | SVM | KAN Deep Learning | |||||
---|---|---|---|---|---|---|---|---|---|---|
Test | Validation | Test | Validation | Test | Validation | Test | Validation | Test | Validation | |
RMSE (mm) | 4.223 | 4.157 | 3.508 | 3.404 | 3.966 | 3.439 | 3.637 | 3.509 | 3.514 | 3.369 |
MRE | 3.864 | 3.152 | 1.375 | 1.326 | 1.771 | 1.658 | 1.561 | 1.525 | 1.208 | 1.018 |
R2 | 0.425 | 0.525 | 0.592 | 0.579 | 0.550 | 0.650 | 0.571 | 0.579 | 0.619 | 0.649 |
MAE (mm) | 2.150 | 2.144 | 1.813 | 1.614 | 1.974 | 1.874 | 1.809 | 1.616 | 1.694 | 1.473 |
Metric | RF | GBDT | SVM | KAN Deep Learning | ||||
---|---|---|---|---|---|---|---|---|
Test | Validation | Test | Validation | Test | Validation | Test | Test | |
RMSE (mm) | 3.799 | 3.566 | 3.449 | 3.422 | 3.675 | 3.472 | 3.117 | 3.017 |
MRE | 1.786 | 1.551 | 1.309 | 1.263 | 1.438 | 1.468 | 0.957 | 0.957 |
R2 | 0.595 | 0.618 | 0.629 | 0.697 | 0.579 | 0.601 | 0.735 | 0.755 |
MAE (mm) | 2.160 | 1.745 | 1.765 | 1.627 | 1.747 | 1.713 | 1.625 | 1.625 |
Main Category | Subcategory | MAE (mm) | MRE | RMSE (mm) | R2 |
---|---|---|---|---|---|
Seasons | Spring | 1.209 | 1.094 | 2.025 | 0.631 |
Summer | 1.787 | 1.278 | 3.759 | 0.516 | |
Autumn | 1.535 | 1.365 | 3.189 | 0.619 | |
Winter | 0.687 | 0.894 | 1.064 | 0.763 | |
Weather Systems | Typhoon | 2.263 | 2.686 | 5.161 | 0.372 |
Frontal System | 1.423 | 0.599 | 3.093 | 0.642 | |
Meiyu Season | 3.077 | 1.109 | 4.226 | 0.798 | |
Summer Convective | 2.645 | 1.980 | 4.806 | 0.560 | |
Rainfall Intensity | Heavy Rain | 11.074 | 0.910 | 12.205 | 0.241 |
Moderate Rain | 1.575 | 1.098 | 2.747 | 0.571 | |
Light Rain | 1.472 | 1.176 | 2.144 | 0.778 | |
Duration | 1–6 h | 2.249 | 1.415 | 3.555 | 0.408 |
7–12 h | 1.910 | 0.824 | 2.945 | 0.530 | |
Over 12 h | 1.229 | 0.480 | 2.545 | 0.751 | |
Overall | 1.625 | 0.957 | 3.117 | 0.735 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, M.; Zuo, J.; Tan, J.; Liu, D. Comparing and Optimizing Four Machine Learning Approaches to Radar-Based Quantitative Precipitation Estimation. Remote Sens. 2024, 16, 4713. https://doi.org/10.3390/rs16244713
Liu M, Zuo J, Tan J, Liu D. Comparing and Optimizing Four Machine Learning Approaches to Radar-Based Quantitative Precipitation Estimation. Remote Sensing. 2024; 16(24):4713. https://doi.org/10.3390/rs16244713
Chicago/Turabian StyleLiu, Miaomiao, Juncheng Zuo, Jianguo Tan, and Dongwei Liu. 2024. "Comparing and Optimizing Four Machine Learning Approaches to Radar-Based Quantitative Precipitation Estimation" Remote Sensing 16, no. 24: 4713. https://doi.org/10.3390/rs16244713
APA StyleLiu, M., Zuo, J., Tan, J., & Liu, D. (2024). Comparing and Optimizing Four Machine Learning Approaches to Radar-Based Quantitative Precipitation Estimation. Remote Sensing, 16(24), 4713. https://doi.org/10.3390/rs16244713