[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3357384.3357832acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Matrix Factorization for Spatio-Temporal Neural Networks with Applications to Urban Flow Prediction

Published: 03 November 2019 Publication History

Abstract

Predicting urban flow is essential for city risk assessment and traffic management, which profoundly impacts people's lives and property. Recently, some deep learning models, focusing on capturing spatio-temporal (ST) correlations between urban regions, have been proposed to predict urban flows. However, these models overlook latent region functions that impact ST correlations greatly. Thus, it is necessary to have a framework to assist these deep models in tackling the region function issue. However, it is very challenging because of two problems: 1) how to make deep models predict flows taking into consideration latent region functions; 2) how to make the framework generalize to a variety of deep models. To tackle these challenges, we propose a novel framework that employs matrix factorization for spatio-temporal neural networks (MF-STN), capable of enhancing the state-of-the-art deep ST models. MF-STN consists of two components: 1) a ST feature learner, which obtains features of ST correlations from all regions by the corresponding sub-networks in the existing deep models; and 2) a region-specific predictor, which leverages the learned ST features to make region-specific predictions. In particular, matrix factorization is employed on the neural networks, namely, decomposing the region-specific parameters of the predictor into learnable matrices, i.e., region embedding matrices and parameter embedding matrices, to model latent region functions and correlations among regions. Extensive experiments were conducted on two real-world datasets, illustrating that MF-STN can significantly improve the performance of some representative ST models while preserving model complexity.

References

[1]
Nicolas Ballas, Li Yao, Chris Pal, and Aaron Courville. 2015. Delving deeper into convolutional networks for learning video representations. arXiv preprint arXiv:1511.06432 (2015).
[2]
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).
[3]
Xu Geng, Yaguang Li, Leye Wang, Lingyu Zhang, Qiang Yang, Jieping Ye, and Yan Liu. 2019. Spatiotemporal multi-graph convolution network for ride-hailing demand forecasting. In AAAI .
[4]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR .
[5]
Minh X Hoang, Yu Zheng, and Ambuj K Singh. 2016. FCCF: forecasting citywide crowd flows based on big data. In SIGSPATIAL. ACM.
[6]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[7]
Benjamin Klein, Lior Wolf, and Yehuda Afek. 2015. A dynamic convolutional layer for short range weather prediction. In CVPR .
[8]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In NIPS .
[9]
Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2018. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. In ICLR .
[10]
Yexin Li and Yu Zheng. 2019. Citywide Bike Usage Prediction in a Bike-Sharing System. TKDE (2019).
[11]
Yexin Li, Yu Zheng, Huichu Zhang, and Lei Chen. 2015. Traffic prediction in a bike-sharing system. In SIGSPATIAL. ACM.
[12]
Yuxuan Liang, Songyu Ke, Junbo Zhang, Xiuwen Yi, and Yu Zheng. 2018. GeoMAN: Multi-level Attention Networks for Geo-sensory Time Series Prediction. In IJCAI .
[13]
Shaohui Lin, Rongrong Ji, Xiaowei Guo, Xuelong Li, et almbox. 2016. Towards Convolutional Neural Networks Compression via Global Error Reconstruction. In IJCAI .
[14]
Ye Liu, Yu Zheng, Yuxuan Liang, Shuming Liu, and David S Rosenblum. 2016. Urban water quality prediction based on multi-task multi-view learning. In IJCAI .
[15]
Xiaolei Ma, Zhuang Dai, Zhengbing He, Jihui Ma, Yong Wang, and Yunpeng Wang. 2017. Learning traffic as images: a deep convolutional neural network for large-scale transportation network speed prediction. Sensors, Vol. 17, 4 (2017), 818.
[16]
Xiaolei Ma, Zhimin Tao, Yinhai Wang, Haiyang Yu, and Yunpeng Wang. 2015. Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transportation Research Part C: Emerging Technologies, Vol. 54 (2015), 187--197.
[17]
Zheyi Pan, Yuxuan Liang, Weifeng Wang, Yong Yu, Yu Zheng, and Junbo Zhang. 2019. Urban Traffic Prediction from Spatio-Temporal Data Using Deep Meta Learning. In SIGKDD. ACM.
[18]
Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo. 2015. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In NIPS .
[19]
Matthew Sotoudeh and Sara S Baghsorkhi. 2018. DeepThin: A self-compressing library for deep neural networks. arXiv preprint arXiv:1802.06944 (2018).
[20]
Yongxue Tian and Li Pan. 2015. Predicting short-term traffic flow by long short-term memory recurrent neural network. In 2015 IEEE international conference on smart city/SocialCom/SustainCom (SmartCity). IEEE, 153--158.
[21]
Zonghan Wu, Shirui Pan, Guodong Long, Jing Jiang, and Chengqi Zhang. 2019. Graph WaveNet for Deep Spatial-Temporal Graph Modeling. IJCAI (2019).
[22]
Yongxin Yang and Timothy Hospedales. 2017. Deep multi-task representation learning: A tensor factorisation approach. ICLR (2017).
[23]
Huaxiu Yao, Xianfeng Tang, Hua Wei, Guanjie Zheng, and Zhenhui Li. 2019. Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction. AAAI .
[24]
Huaxiu Yao, Fei Wu, Jintao Ke, Xianfeng Tang, Yitian Jia, Siyu Lu, Pinghua Gong, and Jieping Ye. 2018. Deep multi-view spatial-temporal network for taxi demand prediction. AAAI .
[25]
Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2018. Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. IJCAI (2018).
[26]
Xiyu Yu, Tongliang Liu, Xinchao Wang, and Dacheng Tao. 2017. On compressing deep models by low rank and sparse decomposition. In CVPR .
[27]
Jing Yuan, Yu Zheng, Xing Xie, and Guangzhong Sun. 2011. Driving with knowledge from the physical world. In SIGKDD. ACM.
[28]
Jing Yuan, Yu Zheng, Chengyang Zhang, Wenlei Xie, Xing Xie, Guangzhong Sun, and Yan Huang. 2010. T-drive: driving directions based on taxi trajectories. In SIGSPATIAL. ACM.
[29]
Junbo Zhang, Yu Zheng, and Dekang Qi. 2017. Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction. In AAAI .
[30]
Junbo Zhang, Yu Zheng, Dekang Qi, Ruiyuan Li, and Xiuwen Yi. 2016. DNN-based prediction model for spatio-temporal data. In SIGSPATIAL. ACM.
[31]
Junbo Zhang, Yu Zheng, Dekang Qi, Ruiyuan Li, Xiuwen Yi, and Tianrui Li. 2018. Predicting citywide crowd flows using deep spatio-temporal residual networks. AI, Vol. 259 (2018), 147--166.
[32]
Junbo Zhang, Yu Zheng, Junkai Sun, and Dekang Qi. 2019. Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep Learning. TKDE (2019).

Cited By

View all
  • (2025)Optimizing Urban Traffic Incident Prediction With Vertical Federated Learning: A Feature Selection Based ApproachIEEE Transactions on Network Science and Engineering10.1109/TNSE.2024.348726812:1(145-155)Online publication date: Jan-2025
  • (2024)Traffic Prediction with Self-Supervised Learning: A Heterogeneity-Aware Model for Urban Traffic Flow Prediction Based on Self-Supervised LearningMathematics10.3390/math1209129012:9(1290)Online publication date: 24-Apr-2024
  • (2024)A survey on monitoring and management techniques for road traffic congestion in vehicular networksICT Express10.1016/j.icte.2024.10.00710:6(1186-1198)Online publication date: Dec-2024
  • Show More Cited By

Index Terms

  1. Matrix Factorization for Spatio-Temporal Neural Networks with Applications to Urban Flow Prediction

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management
        November 2019
        3373 pages
        ISBN:9781450369763
        DOI:10.1145/3357384
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 03 November 2019

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. matrix factorization
        2. neural networks
        3. urban flow

        Qualifiers

        • Research-article

        Funding Sources

        • National Natural Science Foundation of China Grant

        Conference

        CIKM '19
        Sponsor:

        Acceptance Rates

        CIKM '19 Paper Acceptance Rate 202 of 1,031 submissions, 20%;
        Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

        Upcoming Conference

        CIKM '25

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)64
        • Downloads (Last 6 weeks)6
        Reflects downloads up to 07 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2025)Optimizing Urban Traffic Incident Prediction With Vertical Federated Learning: A Feature Selection Based ApproachIEEE Transactions on Network Science and Engineering10.1109/TNSE.2024.348726812:1(145-155)Online publication date: Jan-2025
        • (2024)Traffic Prediction with Self-Supervised Learning: A Heterogeneity-Aware Model for Urban Traffic Flow Prediction Based on Self-Supervised LearningMathematics10.3390/math1209129012:9(1290)Online publication date: 24-Apr-2024
        • (2024)A survey on monitoring and management techniques for road traffic congestion in vehicular networksICT Express10.1016/j.icte.2024.10.00710:6(1186-1198)Online publication date: Dec-2024
        • (2024)Dual-track Spatio-temporal Learning for Urban Flow Prediction with Adaptive NormalizationArtificial Intelligence10.1016/j.artint.2024.104065(104065)Online publication date: Jan-2024
        • (2024)MSTMN: a novel meta-attention-based multi-task spatiotemporal network for traffic flow predictionNeural Computing and Applications10.1007/s00521-024-10331-x36:36(23195-23222)Online publication date: 10-Oct-2024
        • (2023)Data Assimilation for Agent-Based ModelsMathematics10.3390/math1120429611:20(4296)Online publication date: 15-Oct-2023
        • (2023)Learning Social Meta-knowledge for Nowcasting Human Mobility in DisasterProceedings of the ACM Web Conference 202310.1145/3543507.3583991(2655-2665)Online publication date: 30-Apr-2023
        • (2023)A Neural Network Based on Spatial Decoupling and Patterns Diverging for Urban Rail Transit Ridership PredictionIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.330894924:12(15248-15258)Online publication date: Dec-2023
        • (2023)FedSTN: Graph Representation Driven Federated Learning for Edge Computing Enabled Urban Traffic Flow PredictionIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2022.315705624:8(8738-8748)Online publication date: Aug-2023
        • (2023)High-Resolution Urban Flows Forecasting With Coarse-Grained Spatiotemporal DataIEEE Transactions on Artificial Intelligence10.1109/TAI.2022.31537504:2(315-327)Online publication date: Apr-2023
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media