Abstract
In recent years, deep learning has emerged as one of the primary methods for multivariate time series (MTS) forecasting, achieving significant advancements across various domains. However, most deep learning models often fail to consider the multi-resolution characteristics of time series data, which may lead to information loss issues. In this paper, we explore the utilization of information from raw time series data at various resolutions and propose an effective feature extraction module, called Interactive Feature Enhancement (IFE). In IFE module, a three-branch structure is employed to extract the effective features from the raw MTS. Concretely, we first utilize the convolution operation to generate feature sequences and decompose these sequences and the raw time series into two sub-sequences(odd and even) by down-sampling separately. Next, the four sub-sequences are processed through convolutional layers, where the odd and even sub-sequences are interactively enhanced, respectively resulting in two feature-enhanced sub-sequences. Finally, we use convolutional interaction operations on these feature-enhanced sub-sequences to ensure data integrity. To fully exploit potential features in MTS, we propose a tree-structured architecture (named TIFE) by stacking the IFE module according to the properties of a complete binary tree. We conduct experiments on three MTS datasets of different domains and the experimental results show that TIFE has good forecasting performance. Compared to other baselines, TIFE significantly improves forecasting accuracy, further confirming its effectiveness and superiority.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learningto align and translate. arXiv preprint arXiv:1409.0473 (2014)
Bai, S., Kolter, J.Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arxiv 2018. arXiv preprintarXiv:1803.01271 2(1803), 8 (2018)
Borovykh, A., Bohte, S., Oosterlee, C.W.: Conditional time series forecasting withconvolutional neural networks. arXiv preprint arXiv:1703.04691 (2017)
Dong, R., Wu, L., et al.: Review of application analysis and research progress of deep learning in weather forecasting. J. Comput. Appl. 43(6), 1958 (2023)
Gao, H., Jiang, R., Dong, Z., Deng, J., Song, X.: Spatio-temporal-decoupledmasked pre-training for traffic forecasting. arXiv preprint arXiv:2312.00516 (2023)
Graves, A., Graves, A.: Long short-term memory. Supervised Sequence Labelling with Recurrent Neural Networks, pp. 37–45 (2012)
He, K., Zhang, X., et al.: Deep residual learning for image recognition. In:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Kiranyaz, S., Avci, O., et al.: 1D convolutional neural networks and applications: a survey. Mech. Syst. Sig. Process. 151, 107398 (2021)
Lai, G., Chang, W.C., Yang, Y., Liu, H.: Modeling long-and short-term temporal patterns with deep neural networks. In: The 41st International ACM SIGIRConference on Research & Development in Information Retrieval, pp. 95–104 (2018)
Liu, M., et al.: SciNet: time seriesmodeling and forecasting with sample convolution and interaction. In: Advances in Neural Information Processing Systems, vol. 35, pp. 5816–5828 (2022)
Morid, M.A., Sheng, O.R.L., Dunbar, J.: Time series prediction using deep learning methods in healthcare. ACM Trans. Manag. Inf. Syst. 14(1), 1–29 (2023)
Sun, S., Wu, H., Xiang, L.: City-wide traffic flow forecasting using a deep convolutional neural network. Sensors 20(2), 421 (2020)
Vaswani, A., Shazeer, N., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Wen, Q., et al.: Transformersin time series: a survey. arXiv preprint arXiv:2202.07125 (2022)
Wu, H., Xu, J., Wang, J., Long, M.: Autoformer: decomposition transformers withauto-correlation for long-term series forecasting. In: Advances in Neural Information Processing Systems, vol. 34, pp. 22419–22430 (2021)
Wu, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph wavenet for deep spatial-temporal graph modeling. arXiv preprint arXiv:1906.00121 (2019)
Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: a deeplearning framework for traffic forecasting. arXiv preprint arXiv:1709.04875 (2017)
Yuan, Q., et al.: Deep learning in environmental remote sensing: achievements and challenges. Remote Sens. Environ. 241, 111716 (2020)
Yuan, S., Chen, L., Sun, G., Lin, J.: Analysis of electric load data based on time series. Adv. Appl. Math. 5, 214–224 (2016)
Zhou, H., et al.: Informer: beyond efficient transformer for long sequence time-series forecasting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 11106–11115 (2021)
Acknowledgment
This work is supported by the National Natural Science Foundation of China [grant numbers 62162062], the Science and Technology Project of Jilin Provincial Education Department [JJKH20220538KJ], the Science and Technology Development Plan Project of Jilin Province [20220203127SF].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, Y., Li, H., Zhang, Z. (2024). TIFE: Tree-Structured Interactive Feature Enhancement for Multivariate Time Series Forecasting. In: Huang, DS., Si, Z., Chen, W. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2024. Lecture Notes in Computer Science(), vol 14880. Springer, Singapore. https://doi.org/10.1007/978-981-97-5678-0_12
Download citation
DOI: https://doi.org/10.1007/978-981-97-5678-0_12
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5677-3
Online ISBN: 978-981-97-5678-0
eBook Packages: Computer ScienceComputer Science (R0)