[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

STMGF-Net: A Spatiotemporal Multi-Graph Fusion Network for Vessel Trajectory Forecasting in Intelligent Maritime Navigation

Published: 01 December 2024 Publication History

Abstract

Artificial intelligence and Automatic Identification Systems (AIS) play pivotal roles in intelligent maritime navigation for the modern maritime industry. Many artificial intelligence maritime applications based on AIS data have dramatically benefited traditional operations and managements in the field of maritime industry, and also provided state-of-the-art predictive analytics for vessel collisions and route optimization. However, the problem of modeling the interactions of vessels in complex waters still needs to be adequately addressed. In this paper, we focus on using spatiotemporal AIS data to model and forecast multiple vessel trajectories amid dynamic interaction patterns, and we propose a forecast model based on a novel neural network, namely a spatiotemporal multi-graph fusion network (STMGF-Net). The innovative STMGF-Net comprises three crucial modules. First, a Spatiotemporal graph construction module generates interaction graphs of various navigation modes, such as motions, risks, and attributes of vessels, Second, a multi-mode fusion module embeds and fuses the above interaction graphs into STMGF-Net. Finally, squeeze-and-excitation and temporal convolutional networks are introduced as Squeeze-and-excitation temporal convolutional modules to enhance the overall efficiency of the model significantly. Overall, the STMGF-Net can recognize complex spatiotemporal interaction patterns among neighboring vessels so as to capture and integrate these interaction features for achieving high-precision prediction performance in intelligent maritime navigation. In numerical experiments, three water areas of Zhoushan Islands, Yangshan Waters, and Yangtze River Waters are used as training and testing datasets. The results show that STMGF-Net improved prediction errors of average and final distance with increase of 49.637% and 50.622% than classic and state-of-art graph neural networks.

References

[1]
H. Yu et al., “Ship path optimization that accounts for geographical traffic characteristics to increase maritime port safety,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 6, pp. 5765–5776, Jun. 2022.
[2]
X. Zhang, X. Fu, Z. Xiao, H. Xu, and Z. Qin, “Vessel trajectory prediction in maritime transportation: Current approaches and beyond,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 11, pp. 19980–19998, Nov. 2022.
[3]
M. A. Dulebenets, “A diffused memetic optimizer for reactive berth allocation and scheduling at marine container terminals in response to disruptions,” Swarm Evol. Comput., vol. 80, Jul. 2023, Art. no.
[4]
Y. Zhang, X. Sun, J. Chen, and C. Cheng, “Spatial patterns and characteristics of global maritime accidents,” Rel. Eng. Syst. Saf., vol. 206, Feb. 2021, Art. no.
[5]
E. Tu, G. Zhang, L. Rachmawati, E. Rajabally, and G.-B. Huang, “Exploiting AIS data for intelligent maritime navigation: A comprehensive survey from data to methodology,” IEEE Trans. Intell. Transp. Syst., vol. 19, no. 5, pp. 1559–1582, May 2018.
[6]
Z. H. Munim, M. Dushenko, V. J. Jimenez, M. H. Shakil, and M. Imset, “Big data and artificial intelligence in the maritime industry: A bibliometric review and future research directions,” Maritime Policy Manage., vol. 47, no. 5, pp. 577–597, Jul. 2020.
[7]
R. W. Liu et al., “STMGCN: Mobile edge computing-empowered vessel trajectory prediction using spatio-temporal multigraph convolutional network,” IEEE Trans. Ind. Informat., vol. 18, no. 11, pp. 7977–7987, Nov. 2022.
[8]
C. Schöller, V. Aravantinos, F. Lay, and A. Knoll, “What the constant velocity model can teach us about pedestrian motion prediction,” IEEE Robot. Autom. Lett., vol. 5, no. 2, pp. 1696–1703, Apr. 2020.
[9]
X. R. Li and V. P. Jilkov, “Survey of maneuvering target tracking. Part I. Dynamic models,” IEEE Trans. Aerosp. Electron. Syst., vol. 39, no. 4, pp. 1333–1364, Oct. 2003.
[10]
G. Pallotta, S. Horn, P. Braca, and K. Bryan, “Context-enhanced vessel prediction based on ornstein-uhlenbeck processes using historical AIS traffic patterns: Real-world experimental results,” in Proc. 17th Int. Conf. Inf. Fusion, Jul. 2014, pp. 1–7.
[11]
L. M. Millefiori, P. Braca, K. Bryan, and P. Willett, “Modeling vessel kinematics using a stochastic mean-reverting process for long-term prediction,” IEEE Trans. Aerosp. Electron. Syst., vol. 52, no. 5, pp. 2313–2330, Oct. 2016.
[12]
L.-Z. Sang, X.-P. Yan, A. Wall, J. Wang, and Z. Mao, “CPA calculation method based on AIS position prediction,” J. Navigat., vol. 69, no. 6, pp. 1409–1426, Nov. 2016.
[13]
R. Toledo-Moreo and M. A. Zamora-Izquierdo, “IMM-based lane-change prediction in highways with low-cost GPS/INS,” IEEE Trans. Intell. Transp. Syst., vol. 10, no. 1, pp. 180–185, Mar. 2009.
[14]
R. A. Best and J. P. Norton, “A new model and efficient tracker for a target with curvilinear motion,” IEEE Trans. Aerosp. Electron. Syst., vol. 33, no. 3, pp. 1030–1037, Jul. 1997.
[15]
S. Inoue, M. Hirano, K. Kijima, and J. Takashina, “A practical calculation method of ship maneuvering motion,” Int. Shipbuilding Prog., vol. 28, no. 325, pp. 207–222, Sep. 1981.
[16]
K. Jaskólski, “Automatic identification system (AIS) dynamic data estimation based on discrete Kalman filter (KF) algorithm,” Scientific J. Polish Nav. Acad., vol. 211, no. 4, pp. 71–87, Dec. 2017.
[17]
Q. Wang, Z. Zhang, Z. Wang, Y. Wang, and W. Zhou, “The trajectory prediction of spacecraft by grey method,” Meas. Sci. Technol., vol. 27, no. 8, Aug. 2016, Art. no.
[18]
J. Liu, G. Shi, and K. Zhu, “Vessel trajectory prediction model based on AIS sensor data and adaptive chaos differential evolution support vector regression (ACDE-SVR),” Appl. Sci., vol. 9, no. 15, p. 2983, Jul. 2019.
[19]
L. Du, R. Gao, P. N. Suganthan, and D. Z. W. Wang, “Bayesian optimization based dynamic ensemble for time series forecasting,” Inf. Sci., vol. 591, pp. 155–175, Apr. 2022.
[20]
H. Ma, Y. Zuo, and T. Li, “Vessel navigation behavior analysis and multiple-trajectory prediction model based on AIS data,” J. Adv. Transp., vol. 2022, pp. 1–10, Jan. 2022.
[21]
D.-W. Gao, Y.-S. Zhu, J.-F. Zhang, Y.-K. He, K. Yan, and B.-R. Yan, “A novel MP-LSTM method for ship trajectory prediction based on AIS data,” Ocean Eng., vol. 228, May 2021, Art. no.
[22]
K. Singh, A. Mahajan, and V. Mansotra, “Hybrid CNN-LSTM model combined with feature selection and SMOTE for detection of network attacks,” Int. J. Sensor Netw., vol. 43, no. 4, pp. 208–222, 2023.
[23]
H. Tang, Y. Yin, and H. Shen, “A model for vessel trajectory prediction based on long short-term memory neural network,” J. Mar. Esng. Technol., vol. 21, no. 3, pp. 136–145, May 2022.
[24]
R. W. Liu, K. Hu, M. Liang, Y. Li, X. Liu, and D. Yang, “QSD-LSTM: Vessel trajectory prediction using long short-term memory with quaternion ship domain,” Appl. Ocean Res., vol. 136, Jul. 2023, Art. no.
[25]
Y. Xiao, X. Li, W. Yao, J. Chen, and Y. Hu, “Bidirectional data-driven trajectory prediction for intelligent maritime traffic,” IEEE Trans. Intell. Transp. Syst., vol. 24, no. 2, pp. 1773–1785, Feb. 2023.
[26]
Y. Zhang, J. Wu, H. Xie, R. Hua, and Q. Li, “NASA space station rolling bearings anomaly detection based on PARA-LSTM model,” Int. J. Sensor Netw., vol. 44, no. 1, pp. 49–61, 2024.
[27]
Y. Suo, W. Chen, C. Claramunt, and S. Yang, “A ship trajectory prediction framework based on a recurrent neural network,” Sensors, vol. 20, no. 18, p. 5133, Sep. 2020.
[28]
H. Li, H. Jiao, and Z. Yang, “AIS data-driven ship trajectory prediction modelling and analysis based on machine learning and deep learning methods,” Transp. Res. Part E, Logistics Transp. Rev., vol. 175, Jul. 2023, Art. no.
[29]
N. Forti, L. M. Millefiori, P. Braca, and P. Willett, “Prediction oof vessel trajectories from AIS data via sequence-to-sequence recurrent neural networks,” in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), May 2020, pp. 8936–8940.
[30]
L. You et al., “ST-Seq2Seq: A spatio-temporal feature-optimized Seq2Seq model for short-term vessel trajectory prediction,” IEEE Access, vol. 8, pp. 218565–218574, 2020.
[31]
W. Xu, Z. Ding, and C. Song, “Vehicle lane change trajectory learning and prediction model considering vehicle interactions and driving styles in highway scene,” Int. J. Sensor Netw., vol. 43, no. 3, pp. 172–183, 2023.
[32]
S. Bai, J. Zico Kolter, and V. Koltun, “An empirical evaluation of generic convolutional and recurrent networks for sequence modeling,” 2018, arXiv:1803.01271.
[33]
K. Zhang, C. Zhang, Q. Zhu, Y. Gu, and C. Liu, “Ship trajectory D-TCN prediction method based on satellite remote sensing positioning data,” in Proc. China Autom. Congr. (CAC), Nov. 2022, pp. 1419–1424.
[34]
S. Capobianco, L. M. Millefiori, N. Forti, P. Braca, and P. Willett, “Deep learning methods for vessel trajectory prediction based on recurrent neural networks,” IEEE Trans. Aerosp. Electron. Syst., vol. 57, no. 6, pp. 4329–4346, Dec. 2021.
[35]
Z. Lin, W. Yue, J. Huang, and J. Wan, “Ship trajectory prediction based on the TTCN-attention-GRU model,” Electronics, vol. 12, no. 12, p. 2556, Jun. 2023.
[36]
K. Bao, J. Bi, M. Gao, Y. Sun, X. Zhang, and W. Zhang, “An improved ship trajectory prediction based on AIS data using MHA-BiGRU,” J. Mar. Sci. Eng., vol. 10, no. 6, p. 804, Jun. 2022.
[37]
J. Jiang and Y. Zuo, “Prediction of ship trajectory in nearby port waters based on attention mechanism model,” Sustainability, vol. 15, no. 9, p. 7435, Apr. 2023.
[38]
L. Zhao, Y. Zuo, T. Li, and C. L. P. Chen, “Application of an encoder–decoder model with attention mechanism for trajectory prediction based on AIS data: Case studies from the Yangtze river of China and the Eastern coast of the U.S,” J. Mar. Sci. Eng., vol. 11, no. 8, p. 1530, Jul. 2023.
[39]
A. Tharwat and W. Schenck, “A conceptual and practical comparison of PSO-style optimization algorithms,” Expert Syst. Appl., vol. 167, Apr. 2021, Art. no.
[40]
E. T. Bacalhau, L. Casacio, and A. T. de Azevedo, “New hybrid genetic algorithms to solve dynamic berth allocation problem,” Expert Syst. Appl., vol. 167, Apr. 2021, Art. no.
[41]
E. Singh and N. Pillay, “A study of ant-based pheromone spaces for generation constructive hyper-heuristics,” Swarm Evol. Comput., vol. 72, Jul. 2022, Art. no.
[42]
M. Chen and Y. Tan, “SF-FWA: A self-adaptive fast fireworks algorithm for effective large-scale optimization,” Swarm Evol. Comput., vol. 80, Jul. 2023, Art. no.
[43]
Y. Zheng, X. Lv, L. Qian, and X. Liu, “An optimal BP neural network track prediction method based on a GA–ACO hybrid algorithm,” J. Mar. Sci. Eng., vol. 10, no. 10, p. 1399, Sep. 2022.
[44]
L. Qian, Y. Zheng, L. Li, Y. Ma, C. Zhou, and D. Zhang, “A new method of inland water ship trajectory prediction based on long short-term memory network optimized by genetic algorithm,” Appl. Sci., vol. 12, no. 8, p. 4073, Apr. 2022.
[45]
J. Wang, B. Hu, J. Zhu, and D. Gao, “Ship trajectory prediction model based on PSO-LSTM,” in Proc. 3rd Int. Conf. Big Data, Artif. Intell. Internet Things Eng. (ICBAIE), Jul. 2022, pp. 81–86.
[46]
H. Jia, Y. Yang, J. An, and R. Fu, “A ship trajectory prediction model based on attention-BILSTM optimized by the whale optimization algorithm,” Appl. Sci., vol. 13, no. 8, p. 4907, Apr. 2023.
[47]
H. Feng, G. Cao, H. Xu, and S. S. Ge, “IS-STGCNN: An improved social spatial–temporal graph convolutional neural network for ship trajectory prediction,” Ocean Eng., vol. 266, Dec. 2022, Art. no.
[48]
X. Zhang, J. Liu, P. Gong, C. Chen, B. Han, and Z. Wu, “Trajectory prediction of seagoing ships in dynamic traffic scenes via a gated spatio-temporal graph aggregation network,” Ocean Eng., vol. 287, Nov. 2023, Art. no.
[49]
S. Wang, Y. Li, and H. Xing, “A novel method for ship trajectory prediction in complex scenarios based on spatio-temporal features extraction of AIS data,” Ocean Eng., vol. 281, Aug. 2023, Art. no.
[50]
S. Wang, Y. Li, H. Xing, and Z. Zhang, “Vessel trajectory prediction based on spatio-temporal graph convolutional network for complex and crowded sea areas,” Ocean Eng., vol. 298, Apr. 2024, Art. no.
[51]
X. Huang, Y. Ye, W. Ding, X. Yang, and L. Xiong, “Multi-mode dynamic residual graph convolution network for traffic flow prediction,” Inf. Sci., vol. 609, pp. 548–564, Sep. 2022.
[52]
Q. Zheng and Y. Zhang, “DSTAGCN: Dynamic spatial–temporal adjacent graph convolutional network for traffic forecasting,” IEEE Trans. Big Data, vol. 9, no. 1, pp. 241–253, Feb. 2023.
[53]
M. Liang, R. W. Liu, Y. Zhan, H. Li, F. Zhu, and F.-Y. Wang, “Fine-grained vessel traffic flow prediction with a spatio-temporal multigraph convolutional network,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 12, pp. 23694–23707, Dec. 2022.
[54]
Z. Sheng, Y. Xu, S. Xue, and D. Li, “Graph-based spatial–temporal convolutional network for vehicle trajectory prediction in autonomous driving,” IEEE Trans. Intell. Transp. Syst., vol. 23, no. 10, pp. 17654–17665, Oct. 2022.
[55]
A. Mohamed, K. Qian, M. Elhoseiny, and C. Claudel, “Social-STGCNN: A social spatio-temporal graph convolutional neural network for human trajectory prediction,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2020, pp. 14412–14420.
[56]
Y. Huang, H. Bi, Z. Li, T. Mao, and Z. Wang, “STGAT: Modeling spatial–temporal interactions for human trajectory prediction,” in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Oct. 2019, pp. 6271–6280.
[57]
A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese, “Social LSTM: Human trajectory prediction in crowded spaces,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2016, pp. 961–971.
[58]
Q. Yu, A. P. Teixeira, K. Liu, and C. Guedes Soares, “Framework and application of multi-criteria ship collision risk assessment,” Ocean Eng., vol. 250, Apr. 2022, Art. no.
[59]
Z. Shi, R. Zhen, and J. Liu, “Fuzzy logic-based modeling method for regional multi-ship collision risk assessment considering impacts of ship crossing angle and navigational environment,” Ocean Eng., vol. 259, Sep. 2022, Art. no.
[60]
T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” 2016, arXiv:1609.02907.
[61]
K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2015, pp. 1026–1034.
[62]
A. Vaswani et al., “Attention is all you need,” in Proc. Adv. Neural Inf. Process. Syst., vol. 30, 2017, pp. 1–11.
[63]
J. Hu, L. Shen, G. Sun, and S. Albanie, “Squeeze-and-excitation networks,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2017, pp. 7132–7141.
[64]
L. Zhao, Y. Zuo, W. Zhang, T. Li, and C. L. P. Chen, “End-to-end model-based trajectory prediction for ro-ro ship route using dual-attention mechanism,” Frontiers Comput. Neurosci., vol. 18, Feb. 2024, Art. no.
[65]
M. A. Dulebenets, “An adaptive polyploid memetic algorithm for scheduling trucks at a cross-docking terminal,” Inf. Sci., vol. 565, pp. 390–421, Jul. 2021. 10.1016/j.ins.2021.02.039.
[66]
M. Safaeian, R. Khayamim, E. E. Ozguven, and M. A. Dulebenets, “Sustainable decisions in a ridesharing system with a tri-objective optimization approach,” Transp. Res. Part D, Transp. Environ., vol. 125, Dec. 2023, Art. no.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Intelligent Transportation Systems
IEEE Transactions on Intelligent Transportation Systems  Volume 25, Issue 12
Dec. 2024
2676 pages

Publisher

IEEE Press

Publication History

Published: 01 December 2024

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media