Abstract
Multivariate time series (MTS) forecasting plays an important role in various applications e.g., healthcare, economics, and traffic. Existing GNN-based methods generally utilize a predefined or learned graph to model the complex spatial dependencies between variables. However, these methods heavily rely on unrestricted access to centralized MTS data, which may bring data privacy concerns and a high cost of transferring data. Despite the emergence and success of federated learning (FL) as a decentralized training paradigm, making accurate MTS forecasting in FL is challenging due to the varied inter-variable relations among heterogeneous MTS data. In this paper, we propose a novel federated MTS forecasting framework named Federated Graph Neural Network with Dual Graph Contrast Learning (FedDGCL) to address the challenge. FedDGCL utilizes a dual graph learning module to decompose spatial dependencies as a shared graph for the universal part and a heterogeneous graph for the client-specific part. To ensure distinguishability and diversity of spatial dependencies, a novel graph contrast regularization method is designed to encourage the dual graphs to capture respective spatial information. Finally, FedDGCL introduces a dual temporal graph convolutional network to capture spatial-temporal dependencies. Experiments on five real-world datasets demonstrate that FedDGCL outperforms the state-of-the-art baseline methods while protecting data privacy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Lai, G., Chang, W.C., Yang, Y., Liu, H.: Modeling long-and short-term temporal patterns with deep neural networks. In: SIGIR (2018)
Kapoor, A., et al.: Examining COVID-19 forecasting using Spatio-temporal graph neural networks. In: MLG (2020)
Yoo, J., Soun, Y., Park, Y.C., Kang, U.: Accurate multivariate stock movement prediction via data-axis transformer with multi-level contexts. In: SIGKDD (2021)
Yang, Q., Liu, Y., Chen, T., Tong, Y.: Federated machine learning: concept and applications. ACM TIST 10(2), 1–19 (2019)
Kairouz, P., et al.: Advances and Open Problems in Federated Learning. FTML (2021)
Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: data-driven traffic forecasting. In: ICLR (2018)
Wu, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph WaveNet for deep spatial-temporal graph modeling. In: IJCAI (2019)
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., Zhang, C.: Connecting the dots: multivariate time series forecasting with graph neural networks. In: SIGKDD (2020)
Bai, L., Yao, L., Li, C., Wang, X., Wang, C.: Adaptive graph convolutional recurrent network for traffic forecasting. In: NIPS (2020)
Han, L., Du, B., Sun, L., Fu, Y., Lv, Y., Xiong, H.: Dynamic and multi-faceted Spatio-temporal deep learning for traffic speed forecasting. In: SIGKDD (2021)
Li, T., Sahu, A.K., Zaheer, M., Sanjabi, M., Talwalkar, A., Smith, V.: Federated optimization in heterogeneous networks. In: MLSys (2020)
Karimireddy, S.P., Kale, S., Mohri, M., Reddi, S., Stich, S., Suresh, A.T.: SCAFFOLD: stochastic controlled averaging for federated learning. In: PMLR (2020)
Li, Q., He, B., Song, D.: Model-contrastive federated learning. In: CVPR (2021)
Liu, Y., James, J., Kang, J., Niyato, D., Zhang, S.: Privacy-preserving traffic flow prediction: a federated learning approach. IoTJ 7(8), 7751–7763 (2020)
Yuan, X., et al.: FedSTN: graph representation driven federated learning for edge computing enabled urban traffic flow prediction. TITS 24(8), 8738–8748 (2022)
Meng, C., Rambhatla, S., Liu, Y.: Cross-node federated graph neural network for Spatio-temporal data modeling. In: SIGKDD (2021)
Bartholomew, D.J.: Time Series Analysis Forecasting and Control. (1971)
Frigola, R.: Bayesian time series learning with Gaussian processes, Ph.D. thesis, University of Cambridge (2015)
Shih, S.Y., Sun, F.K., Lee, H.Y.: Temporal pattern attention for multivariate time series forecasting. ML 108, 1421–1441 (2019). https://doi.org/10.1007/s10994-019-05815-0
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks. In: TNNLS (2020)
Fang, Y., et al.: Learning decomposed spatial relations for multi-variate time-series modeling. In: AAAI (2023)
Chen, L., et al.: Multi-scale adaptive graph neural network for multivariate time series forecasting. TKDE 35(10), 10748–10761 (2023)
McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: AISTATS (2017)
Chen, T., Kornblith, S., Norouzi, M., Hinton, G.: A simple framework for contrastive learning of visual representations. In: ICML (2020)
Xu, J., Sun, X., Zhang, Z., Zhao, G., Lin, J.: Understanding and improving layer normalization. NIPS 32 (2019)
Abu-El-Haija, S., et al.: Mixhop: higher-order graph convolutional architectures via sparsified neighborhood mixing. In: ICML (2019)
Bai, S., Kolter, J.Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271 (2018)
Stock, J.H., Watson, M.W.: Vector autoregressions. JEP 15(4), 101–115 (2001)
Chen, W., Chen, L., Xie, Y., Cao, W., Gao, Y., Feng, X.: Multi-range attentive bicomponent graph convolutional network for traffic forecasting. In: AAAI (2020)
Zhou, H., et al.: Informer: beyond efficient transformer for long sequence time-series forecasting. In: AAAI (2021)
Acknowledgements
This work was supported by the National Science and Technology Major Project (No. 2022ZD0115901), in part by the National Natural Science Foundation of China (No. 62177007, No. 62102035, No. 71961022, No. 62302485), and the China Postdoctoral Science Foundation (No. 2022M713206), and CAS Special Research Assistant Program.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhou, Y., Guo, Y., Guo, F., Jing, F., Yang, J., Bie, R. (2024). FedDGCL: Federated Graph Neural Network with Dual Graph Contrast Learning for Multivariable Time Series Forecasting. In: Onizuka, M., et al. Database Systems for Advanced Applications. DASFAA 2024. Lecture Notes in Computer Science, vol 14850. Springer, Singapore. https://doi.org/10.1007/978-981-97-5552-3_27
Download citation
DOI: https://doi.org/10.1007/978-981-97-5552-3_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5551-6
Online ISBN: 978-981-97-5552-3
eBook Packages: Computer ScienceComputer Science (R0)