[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

TARA-Net: A Fusion Network for Detecting Takeaway Rider Accidents

Published: 11 December 2021 Publication History

Abstract

In the emerging business of food delivery, rider traffic accidents raise financial cost and social traffic burden. Although there has been much effort on traffic accident forecasting using temporal-spatial prediction models, none of the existing work studies the problem of detecting the takeaway rider accidents based on food delivery trajectory data. In this article, we aim to detect whether a takeaway rider meets an accident on a certain time period based on trajectories of food delivery and riders’ contextual information. The food delivery data has a heterogeneous information structure and carries contextual information such as weather and delivery history, and trajectory data are collected as a spatial-temporal sequence. In this article, we propose a TakeAway Rider Accident detection fusion network TARA-Net to jointly model these heterogeneous and spatial-temporal sequence data. We utilize the residual network to extract basic contextual information features and take advantage of a transformer encoder to capture trajectory features. These embedding features are concatenated into a pyramidal feed-forward neural network. We jointly train the above three components to combine the benefits of spatial-temporal trajectory data and sparse basic contextual data for early detecting traffic accidents. Furthermore, although traffic accidents rarely happen in food delivery, we propose a sampling mechanism to alleviate the imbalance of samples when training the model. We evaluate the model on a transportation mode classification dataset Geolife and a real-world Ele.me dataset with over 3 million riders. The experimental results show that the proposed model is superior to the state-of-the-art.

References

[1]
Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. 2016. Layer normalization. arXiv: 1607.06450. http://arxiv/org/abs/1607.06450.
[2]
Miguel Ángel Bautista, Antonio Hernández-Vela, Sergio Escalera, Laura Igual, Oriol Pujol, Josep Moya, Verónica Violant, and María Teresa Anguera. 2016. A gesture recognition system for detecting behavioral patterns of ADHD. IEEE Transactions on Cybernetics 46, 1 (2016), 136–147.
[3]
George Bebis and Michael Georgiopoulos. 1994. Feed-forward neural networks. IEEE Potentials 13, 4 (1994), 27–31.
[4]
Jiang Bian, Dayong Tian, Yuanyan Tang, and Dacheng Tao. 2019. Trajectory data classification: A review. ACM Transactions on Intelligent Systems and Technology (TIST) 10, 4 (2019), 1–34.
[5]
Zaiben Chen, Heng Tao Shen, and Xiaofang Zhou. 2011. Discovering popular routes from trajectories. In 2011 IEEE 27th International Conference on Data Engineering. IEEE, 900–911.
[6]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. 2016. Wide and deep learning for recommender systems. In Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 7–10.
[7]
Kyunghyun Cho, Bart van Merrienboer, Çaglar Gülçehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP’14). ACL, 1724–1734.
[8]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv:1406.1078).
[9]
Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine Learning 20, 3 (1995), 273–297.
[10]
Sina Dabiri and Kevin Heaslip. 2018. Inferring transportation modes from GPS trajectories using a convolutional neural network. Transportation Research Part C: Emerging Technologies 86 (2018), 360–371.
[11]
Rupam Deb and Alan Wee-Chung Liew. 2016. Missing value imputation for the analysis of incomplete traffic accident data. Information Sciences 339 (2016), 274–289.
[12]
Maxime Devanne, Stefano Berretti, Pietro Pala, Hazem Wannous, Mohamed Daoudi, and Alberto Del Bimbo. 2017. Motion segment decomposition of RGB-D sequences for human behavior understanding. Pattern Recognition 61 (2017), 222–233.
[13]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT’19, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4171–4186.
[14]
Yuki Endo, Hiroyuki Toda, Kyosuke Nishida, and Akihisa Kawanobe. 2016. Deep feature extraction from trajectories for transportation mode estimation. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 54–66.
[15]
Qiang Gao, Fan Zhou, Kunpeng Zhang, Goce Trajcevski, Xucheng Luo, and Fengli Zhang. 2017. Identifying human mobility via trajectory embeddings. In International Joint Conference on Artificial Intelligence, Vol. 17. 1689–1695.
[16]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 315–323.
[17]
Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: A factorization-machine based neural network for CTR prediction. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI’17), ijcai.org, 1725–1731.
[18]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Rrecognition. 770–778.
[19]
Tianfu He, Jie Bao, Ruiyuan Li, Sijie Ruan, Yanhua Li, Chao Tian, and Yu Zheng. 2018. Detecting vehicle illegal parking events using sharing bikes’ trajectories. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 340–349.
[20]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735–1780.
[21]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735–1780.
[22]
Kurt Hornik, Maxwell Stinchcombe, Halbert White, et al. 1989. Multilayer feedforward networks are universal approximators. Neural Networks 2, 5 (1989), 359–366.
[23]
Han Hu, Jianjiang Feng, and Jie Zhou. 2014. Exploiting unsupervised and supervised constraints for subspace clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 37, 8 (2014), 1542–1557.
[24]
Weiming Hu, Xi Li, Guodong Tian, Stephen Maybank, and Zhongfei Zhang. 2013. An incremental DPMM-based method for trajectory clustering, modeling, and retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 5 (2013), 1051–1065.
[25]
Chao Huang, Chuxu Zhang, Peng Dai, and Liefeng Bo. 2019. Deep dynamic fusion network for traffic accident forecasting. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (CIKM’19). ACM, 2673–2681.
[26]
Xiaohui Huang, Pan He, Anand Rangarajan, and Sanjay Ranka. 2020. Intelligent intersection: Two-stream convolutional networks for real-time near-accident detection in traffic video. ACM Transactions on Spatial Algorithms and Systems (TSAS) 6, 2 (2020), 1–28.
[27]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations (ICLR’15).
[28]
David G. Kleinbaum, K. Dietz, M. Gail, Mitchel Klein, and Mitchell Klein. 2002. Logistic Regression. Springer.
[29]
Dejiang Kong and Fei Wu. 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction. In Proceedings of the 24th International Joint Conference on Artificial Intelligence, Vol. 18. 2341–2347.
[30]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Advances in Neural Information Processing Systems. 1097–1105.
[31]
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 11 (1998), 2278–2324.
[32]
Xi Li, Weiming Hu, and Wei Hu. 2006. A coarse-to-fine strategy for vehicle motion trajectory clustering. In Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06). IEEE Computer Society, 591–594.
[33]
Yuhong Li, Jie Bao, Yanhua Li, Yingcai Wu, Zhiguo Gong, and Yu Zheng. 2016. Mining the most influential k-location set from massive trajectories. In Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. 1–4.
[34]
Jianxun Lian, Xiaohuan Zhou, Fuzheng Zhang, Zhongxia Chen, Xing Xie, and Guangzhong Sun. 2018. XDeepFM: Combining explicit and implicit feature interactions for recommender systems. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD’18). ACM, 1754–1763.
[35]
Dongyu Liu, Di Weng, Yuhong Li, Jie Bao, Yu Zheng, Huamin Qu, and Yingcai Wu. 2016. SmartAdP: Visual analytics of large-scale taxi trajectories for selecting billboard locations. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2016), 1–10.
[36]
Hongbin Liu and Ickjai Lee. 2017. End-to-end trajectory transportation mode classification using Bi-LSTM recurrent neural network. In 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE’17). IEEE, 1–5.
[37]
Hongbin Liu, Hao Wu, Weiwei Sun, and Ickjai Lee. 2019. Spatio-temporal GRU for trajectory classification. In 2019 IEEE International Conference on Data Mining (ICDM’19). IEEE, 1228–1233.
[38]
Jianming Lv, Qing Li, Qinghui Sun, and Xintong Wang. 2018. T-CONV: A convolutional neural network for multi-scale taxi trajectory prediction. In Proceedings of the IEEE International Conference on Big Data and Smart Computing. 82–89.
[39]
Henry Martin, Dominik Bucher, Esra Suel, Pengxiang Zhao, Fernando Perez-Cruz, and Martin Raubal. 2018. Graph convolutional neural networks for human activity purpose imputation. In Proceedings of the NIPS Spatiotemporal Workshop at the 32nd Annual Conference on Neural Information Processing Systems (NIPS’18).
[40]
Randa Oqab Mujalli, Griselda López, and Laura Garach. 2016. Bayes classifiers for imbalanced traffic accidents datasets. Accident Analysis & Prevention 88 (2016), 37–51.
[41]
Mirco Nanni and Dino Pedreschi. 2006. Time-focused clustering of trajectories of moving objects. Journal of Intelligent Information Systems 27, 3 (2006), 267–289.
[42]
V. A. Olutayo and A. A. Eludire. 2014. Traffic accident analysis using decision trees and neural networks. International Journal of Information Technology and Computer Science 2 (2014), 22–28.
[43]
Honglei Ren, You Song, Jingxin Liu, Yucheng Hu, and Jinzhi Lei. 2017. A deep learning approach to the prediction of short-term traffic accident risk. CoRR abs/1710.09543 (2017). arxiv:1710.09543. http://arxiv.org/abs/1710.09543.
[44]
Samy Sadeky, Ayoub Al-Hamadiy, Bernd Michaelisy, and Usama Sayed. 2010. Real-time automatic traffic accident recognition using HFG. In Proceedings of the 2010 20th International Conference on Pattern Recognition. IEEE, 3348–3351.
[45]
Bharti Sharma, Vinod Kumar Katiyar, and Kranti Kumar. 2016. Traffic accident prediction model using support vector machines with Gaussian kernel. In Proceedings of the 5th International Conference on Soft Computing for Problem Solving. Springer, 1–10.
[46]
Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo. 2015. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. arXiv:1506.04214.
[47]
Yemin Shi, Yonghong Tian, Yaowei Wang, and Tiejun Huang. 2017. Sequential deep trajectory descriptor for action recognition with three-stream CNN. IEEE Transactions on Multimedia 19, 7 (2017), 1510–1520.
[48]
Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In Proceedings of the 3rd International Conference on Learning Representations (ICLR’15), Conference Track Proceedings.
[49]
Dinesh Singh and Chalavadi Krishna Mohan. 2018. Deep spatio-temporal representation for detection of road accidents using stacked autoencoder. IEEE Transactions on Intelligent Transportation Systems 20, 3 (2018), 879–887.
[50]
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15, 1 (2014), 1929–1958.
[51]
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1–9.
[52]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems. 5998–6008.
[53]
Dong Wang, Junbo Zhang, Wei Cao, Jian Li, and Yu Zheng. 2018. When will you arrive? Estimating travel time based on deep neural networks. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence. AAAI Press, 2500–2507.
[54]
Heng Wang, Alexander Kläser, Cordelia Schmid, and Cheng-Lin Liu. 2011. Action recognition by dense trajectories. In CVPR 2011. IEEE, 3169–3176.
[55]
Jing Wang and Xin Wang. 2011. An ontology-based traffic accident risk mapping framework. In International Symposium on Spatial and Temporal Databases. Springer, 21–38.
[56]
Ruoxi Wang, Bin Fu, Gang Fu, and Mingliang Wang. 2017. Deep and cross network for ad click predictions. In Proceedings of the ADKDD’17. 1–7.
[57]
Guojun Wu, Yichen Ding, Yanhua Li, Jie Bao, Yu Zheng, and Jun Luo. 2017. Mining spatio-temporal reachable regions over massive trajectory data. In Proceedings of the 2017 IEEE 33rd International Conference on Data Engineering (ICDE’17). IEEE, 1283–1294.
[58]
Jiajie Xu, Jing Zhao, Rui Zhou, Chengfei Liu, Pengpeng Zhao, and Lei Zhao. 2019. Destination prediction a deep learning based approach. IEEE Transactions on Knowledge and Data Engineering 33, 2 (2019), 651–666.
[59]
Kaiping Xu, Zheng Qin, Guolong Wang, Kai Huang, Shuxiong Ye, and Huidi Zhang. 2018. Collision-free LSTM for human trajectory prediction. In Proceedings of International Conference on MultiMedia Modeling. Springer International Publishing, Cham, 106–116.
[60]
Yuan Yuan, Yachuang Feng, and Xiaoqiang Lu. 2016. Statistical hypothesis detector for abnormal event detection in crowded scenes. IEEE Transactions on Cybernetics 47, 11 (2016), 3597–3608.
[61]
Zhuoning Yuan, Xun Zhou, and Tianbao Yang. 2018. Hetero-convLSTM: A deep learning approach to traffic accident prediction on heterogeneous spatio-temporal data. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 984–992.
[62]
Tianzhu Zhang, Hanqing Lu, and Stan Z. Li. 2009. Learning semantic scene models by object classification and trajectory clustering. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1940–1947.
[63]
Yang Zhang, Xiangyu Dong, Lanyu Shang, Daniel Zhang, and Dong Wang. 2020. A multi-modal graph neural network approach to traffic risk forecasting in smart urban sensing. In Proceedings of the 2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON’20). IEEE, 1–9.
[64]
Yu Zheng. 2015. Trajectory data mining: An overview. ACM Transactions on Intelligent Systems and Technology (TIST) 6, 3 (2015), 1–41.
[65]
Yu Zheng, Quannan Li, Yukun Chen, Xing Xie, and Wei-Ying Ma. 2008. Understanding mobility based on GPS data. In Proceedings of the 10th International Conference on Ubiquitous Computing. 312–321.
[66]
Yu Zheng, Xing Xie, Wei-Ying Ma, et al. 2010. GeoLife: A collaborative social networking service among user, location and trajectory. IEEE Data Engineering Bulletin 33, 2 (2010), 32–39.
[67]
Yu Zheng, Lizhu Zhang, Xing Xie, and Wei-Ying Ma. 2009. Mining interesting locations and travel sequences from GPS trajectories. In Proceedings of the 18th International Conference on World Wide Web. 791–800.
[68]
Zhengyang Zhou, Yang Wang, Xike Xie, Lianliang Chen, and Hengchang Liu. 2020. RiskOracle: A minute-level citywide traffic accident forecasting framework. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 1258–1265.

Cited By

View all
  • (2025)Riding safety Evaluation of food delivery motor scooters based on Associating Sensor-based riding behavior and road traffic characteristicsAccident Analysis & Prevention10.1016/j.aap.2024.107871211(107871)Online publication date: Mar-2025
  • (2024)Adaptive Context Based Road Accident Risk Prediction Using Spatio-Temporal Deep LearningIEEE Transactions on Artificial Intelligence10.1109/TAI.2023.33285785:6(2872-2883)Online publication date: Jun-2024
  • (2024)Near-crash risk identification and evaluation for takeout delivery motorcycles using roadside LiDARAccident Analysis & Prevention10.1016/j.aap.2024.107520199(107520)Online publication date: May-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 12, Issue 6
December 2021
356 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3501281
  • Editor:
  • Huan Liu
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2021
Accepted: 01 March 2021
Revised: 01 February 2021
Received: 01 October 2020
Published in TIST Volume 12, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Traffic accident detection
  2. trajectory data
  3. transformer encoder
  4. residual network
  5. deep learning

Qualifiers

  • Research-article
  • Refereed

Funding Sources

  • Open Research Program of Zhejiang Lab

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)93
  • Downloads (Last 6 weeks)4
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2025)Riding safety Evaluation of food delivery motor scooters based on Associating Sensor-based riding behavior and road traffic characteristicsAccident Analysis & Prevention10.1016/j.aap.2024.107871211(107871)Online publication date: Mar-2025
  • (2024)Adaptive Context Based Road Accident Risk Prediction Using Spatio-Temporal Deep LearningIEEE Transactions on Artificial Intelligence10.1109/TAI.2023.33285785:6(2872-2883)Online publication date: Jun-2024
  • (2024)Near-crash risk identification and evaluation for takeout delivery motorcycles using roadside LiDARAccident Analysis & Prevention10.1016/j.aap.2024.107520199(107520)Online publication date: May-2024
  • (2023)Identification and Tracking of Takeout Delivery Motorcycles Using Low-Channel Roadside LiDARIEEE Sensors Journal10.1109/JSEN.2023.326329823:9(9786-9795)Online publication date: 1-May-2023

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media