Abstract
Geomagnetic activities have a crucial impact on Earth, which can affect spacecraft and electrical power grids. Geospace scientists use a geomagnetic index, called the Kp index, to describe the overall level of geomagnetic activity. This index is an important indicator of disturbances in the Earth’s magnetic field and is used by the U.S. Space Weather Prediction Center as an alert and warning service for users who may be affected by the disturbances. Early and accurate prediction of the Kp index is essential for preparedness and disaster risk management. In this paper, we present a novel deep learning method, named KpNet, to perform short-term, 1–9 hour ahead, forecasting of the Kp index based on the solar wind parameters taken from the NASA Space Science Data Coordinated Archive. KpNet combines transformer encoder blocks with Bayesian inference, which is capable of quantifying both aleatoric uncertainty (data uncertainty) and epistemic uncertainty (model uncertainty) when making Kp predictions. Experimental results show that KpNet outperforms closely related machine learning methods in terms of the root mean square error and R-squared score. Furthermore, KpNet can provide both data and model uncertainty quantification results, which the existing methods cannot offer. To our knowledge, this is the first time that Bayesian transformers have been used for Kp prediction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
Following [18], we set b to 8 in this study.
- 6.
In the study presented here, K is set to 100.
References
Abduallah, Y., Wang, J.T.L., Shen, Y., Alobaid, K.A., Criscuoli, S., Wang, H.: Reconstruction of total solar irradiance by deep learning. In: Proceedings of the International Conference of the Florida Artificial Intelligence Research Society (FLAIRS-34) (2021)
Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112, 859–877 (2016)
Boberg, F., Wintoft, P., Lundstedt, H.: Real time Kp predictions from solar wind data using neural networks. Phys. Chem. Earth Part C Sol. Terr. Planet. Sci. 25(4), 275–280 (2000)
Chakraborty, S., Morley, S.K.: Probabilistic prediction of geomagnetic storms and the Kp index. J. Space Weather Space Clim. 10, 36 (2020). https://doi.org/10.1051/swsc/2020037
Costello, K.A.: Moving the Rice MSFM into a real-time forecast mode using solar wind driven forecast modules, Ph.D. dissertation, Rice University (1998)
Gal, Y., Ghahramani, Z.: Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: Proceedings of the 33rd International Conference on Machine Learning, pp. 1050–1059 (2016)
Goodfellow, I.J., Bengio, Y., Courville, A.C.: Deep Learning. MIT Press (2016). http://www.deeplearningbook.org
Graves, A.: Practical variational inference for neural networks. In: Proceedings of the Annual Conference on Neural Information Processing Systems (2011)
Ji, E.Y., Moon, Y.J., Park, J., Lee, J.Y., Lee, D.H.: Comparison of neural network and support vector machine methods for Kp forecasting. J. Geophys. Res. Space Phys. 118(8), 5109–5117 (2013)
Jiang, H., et al.: Tracing H\(\alpha \) fibrils through Bayesian deep learning. Astrophys.J. Suppl. Ser. 256(20) (2021)
Kendall, A., Gal, Y.: What uncertainties do we need in Bayesian deep learning for computer vision? In: Proceedings of the Annual Conference on Neural Information Processing Systems (2017)
Kwon, Y., Won, J.H., Kim, B.J., Paik, M.C.: Uncertainty quantification using Bayesian neural networks in classification: application to biomedical image segmentation. Comput. Stat. Data Anal. 142, 106816 (2020)
Ling, Z.H., Dai, L.R.: Minimum Kullback–Leibler divergence parameter generation for HMM-based speech synthesis. IEEE Trans. Audio Speech Lang Process. 20(5), 1492–1502 (2012)
Shprits, Y.Y., Vasile, R., Zhelavskaya, I.S.: Nowcasting and predicting the Kp index using historical values and real-time observations. Space Weather 17(8), 1219–1229 (2019)
Siciliano, F., Consolini, G., Tozzi, R., Gentili, M., Giannattasio, F., De Michelis, P.: Forecasting SYM-H index: a comparison between long short-term memory and convolutional neural networks. Space Weather 19(2) (2021)
Tan, Y., Hu, Q., Wang, Z., Zhong, Q.: Geomagnetic index Kp forecasting with LSTM. Space Weather 16(4), 406–416 (2018)
Tran, D., Dusenberry, M.W., van der Wilk, M., Hafner, D.: Bayesian layers: a module for neural network uncertainty. In: Proceedings of the Annual Conference on Neural Information Processing Systems (2019)
Vaswani, A., et al.: Attention is all you need. In: Proceedings of the Annual Conference on Neural Information Processing Systems (2017)
Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., Eickhoff, C.: A transformer-based framework for multivariate time series representation learning. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 2114–2124 (2021)
Zhelavskaya, I.S., Vasile, R., Shprits, Y.Y., Stolle, C., Matzka, J.: Systematic analysis of machine learning and feature selection techniques for prediction of the Kp index. Space Weather 17(10), 1461–1486 (2019)
Acknowledgments
This work was supported in part by the U.S. National Science Foundation under Grant Nos. AGS–1927578 and AGS–2149748. We acknowledge the use of NASA/GSFC’s OMNIWeb and OMNI data.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Abduallah, Y., Wang, J.T.L., Xu, C., Wang, H. (2022). A Transformer-Based Framework for Geomagnetic Activity Prediction. In: Ceci, M., Flesca, S., Masciari, E., Manco, G., Raś, Z.W. (eds) Foundations of Intelligent Systems. ISMIS 2022. Lecture Notes in Computer Science(), vol 13515. Springer, Cham. https://doi.org/10.1007/978-3-031-16564-1_31
Download citation
DOI: https://doi.org/10.1007/978-3-031-16564-1_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16563-4
Online ISBN: 978-3-031-16564-1
eBook Packages: Computer ScienceComputer Science (R0)