STFP: Simultaneous Traffic Scene Forecasting and Planning for Autonomous Driving
Pages 6016 - 6022
Abstract
Autonomous vehicles must be able to understand the surrounding traffic flows and predict the future traffic conditions for planning a safe maneuver. During prediction, the action of autonomous vehicles should be considered, as it influences the interaction between vehicles sharing the same traffic scene and thus influences the future traffic flow. From this perspective, not only should the prediction be considered for planning, but also the action of autonomous vehicles generated by planning should be considered for traffic scene prediction. Therefore, prediction and planning must work interactively at every time step, considering results of each other. In this paper, we present a novel learning-based framework that simultaneously forecasts a nearby traffic scene and plans a maneuver of autonomous vehicle at every time step. Through experiments, we demonstrated that the proposed method exhibits better planning performance than baselines in complex traffic conditions involving various surrounding vehicles.
References
[1]
S. Kim, G. Gwon, W. Hur, D. Hyeon, D. Kim, S. Kim, D. Kye, S. Lee, S. Lee, M. Shin, and S. Seo, “Autonomous campus mobility services using driverless taxi,” IEEE Transactions on Intelligent Transportation Systems, vol. 18, no. 12, pp. 3513–3526, 2017.
[2]
R. Toledo-Moreo and M. A. Zamora-Izquierdo, “Imm-based lane-change prediction in highways with low-cost gps/ins,” IEEE Transactions on Intelligent Transportation Systems, vol. 10, no. 1, pp. 180–185, 2009.
[3]
F. Large, D. Vasquez, T. Fraichard, and C. Laugier, “Avoiding cars and pedestrians using velocity obstacles and motion prediction,” in IEEE Intelligent Vehicles Symposium, 2004, 2004, pp. 375–379.
[4]
E. J. Heravi and S. Khanmohammadi, “Long term trajectory prediction of moving objects using gaussian process,” in 2011 First International Conference on Robot, Vision and Signal Processing, 2011, pp. 228–232.
[5]
L. Hewing, E. Arcari, L. P. Fröhlich, and M. N. Zeilinger, “On simulation and trajectory prediction with gaussian process dynamics,” in Proceedings of the 2nd Conference on Learning for Dynamics and Control, vol. 120. PMLR, 10–11 Jun 2020, pp. 424–434.
[6]
F. Altché and A. de La Fortelle, “An lstm network for highway trajectory prediction,” in 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), 2017, pp. 353–359.
[7]
S. Dai, L. Li, and Z. Li, “Modeling vehicle interactions via modified lstm models for trajectory prediction,” IEEE Access, vol. 7, pp. 38 287–38 296, 2019.
[8]
A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese, “Social lstm: Human trajectory prediction in crowded spaces,” in CVPR, June 2016.
[9]
W. Luo, B. Yang, and R. Urtasun, “Fast and furious: Real time end-to-end 3d detection, tracking and motion forecasting with a single convolutional net,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.
[10]
Y. Jeong and K. Yi, “Target vehicle motion prediction-based motion planning framework for autonomous driving in uncontrolled intersections,” IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 1, pp. 168–177, 2021.
[11]
Y. Jeong, S. Kim, and K. Yi, “Surround vehicle motion prediction using lstm-rnn for motion planning of autonomous vehicles at multi-lane turn intersections,” IEEE Open Journal of Intelligent Transportation Systems, vol. 1, pp. 2–14, 2020.
[12]
L. Zhang, W. Xiao, Z. Zhang, and D. Meng, “Surrounding vehicles motion prediction for risk assessment and motion planning of autonomous vehicle in highway scenarios,” IEEE Access, vol. 8, pp. 209 356–209 376, 2020.
[13]
S. Casas, A. Sadat, and R. Urtasun, “Mp3: A unified model to map, perceive, predict and plan,” 2021.
[14]
A. Sadat, S. Casas, M. Ren, X. Wu, P. Dhawan, and R. Urtasun, “Perceive, predict, and plan: Safe motion planning through interpretable semantic representations,” in Computer Vision – ECCV 2020, 2020, pp. 414–430.
[15]
W. Zeng, S. Wang, R. Liao, Y. Chen, B. Yang, and R. Urtasun, “Dsdnet: Deep structured self-driving network,” in Computer Vision – ECCV 2020, 2020, pp. 156–172.
[16]
S. Kim and W. Liu, “Cooperative autonomous driving: A mirror neuron inspired intention awareness and cooperative perception approach,” IEEE Intelligent Transportation Systems Magazine, vol. 8, no. 3, pp. 23–32, 2016.
[17]
S. Lefèvre, C. Laugier, and J. Ibañez-Guzmán, “Exploiting map information for driver intention estimation at road intersections,” in 2011 IEEE Intelligent Vehicles Symposium (IV), 2011, pp. 583–588.
[18]
S. H. Park, B. Kim, C. M. Kang, C. C. Chung, and J. W. Choi, “Sequence-to-sequence prediction of vehicle trajectory via lstm encoder-decoder architecture,” in 2018 IEEE Intelligent Vehicles Symposium (IV), 2018, pp. 1672–1678.
[19]
S. Hoermann, M. Bach, and K. Dietmayer, “Dynamic occupancy grid prediction for urban autonomous driving: A deep learning approach with fully automatic labeling,” in 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 2056–2063.
[20]
M. Schreiber, S. Hoermann, and K. Dietmayer, “Long-term occupancy grid prediction using recurrent neural networks,” in 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 9299–9305.
[21]
N. Mohajerin and M. Rohani, “Multi-step prediction of occupancy grid maps with recurrent neural networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
[22]
M. Buehler, K. Iagnemma, and S. Singh, The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, 1st ed. Springer Publishing Company, Incorporated, 2009.
[23]
J. Ziegler, P. Bender, T. Dang, and C. Stiller, “Trajectory planning for bertha — a local, continuous method,” in 2014 IEEE Intelligent Vehicles Symposium Proceedings, 2014, pp. 450–457.
[24]
B. D. Ziebart, A. Maas, J. A. Bagnell, and A. K. Dey, “Maximum entropy inverse reinforcement learning,” in Proceedings of the 23rd National Conference on Artificial Intelligence - Volume 3, 2008, p. 1433–1438.
[25]
W. Zeng, W. Luo, S. Suo, A. Sadat, B. Yang, S. Casas, and R. Urtasun, “End-to-end interpretable neural motion planner,” in CVPR, June 2019.
[26]
M. Wulfmeier, P. Ondruska, and I. Posner, “Maximum entropy deep inverse reinforcement learning,” 2016.
[27]
D. A. Pomerleau, “ALVINN: an autonomous land vehicle in a neural network,” in Advances in Neural Information Processing Systems 1, 1989, pp. 305–313.
[28]
H. Xu, Y. Gao, F. Yu, and T. Darrell, “End-to-end learning of driving models from large-scale video datasets,” in CVPR, July 2017.
[29]
J. Chen, B. Yuan, and M. Tomizuka, “Deep imitation learning for autonomous driving in generic urban scenarios with enhanced safety,” 2019.
[30]
X. Shi, Z. Chen, H. Wang, D.-Y. Yeung, W. kin Wong, and W. chun Woo, “Convolutional lstm network: A machine learning approach for precipitation nowcasting,” 2015.
[31]
S. W. Kim, Y. Zhou, J. Philion, A. Torralba, and S. Fidler, “Learning to simulate dynamic environments with gamegan,” 2020.
[32]
D. Ha and J. Schmidhuber, “Recurrent world models facilitate policy evolution,” in Advances in Neural Information Processing Systems 31, 2018, pp. 2451–2463.
[33]
J. Houston, G. Zuidhof, L. Bergamini, Y. Ye, L. Chen, A. Jain, S. Omari, V. Iglovikov, and P. Ondruska, “One thousand and one hours: Self-driving motion prediction dataset,” 2020.
[34]
A. Dosovitskiy, G. Ros, F. Codevilla, A. Lopez, and V. Koltun, “CARLA: An open urban driving simulator,” in Proceedings of the 1st Annual Conference on Robot Learning, vol. 78, 13–15 Nov 2017, pp. 1–16.
Index Terms
- STFP: Simultaneous Traffic Scene Forecasting and Planning for Autonomous Driving
Index terms have been assigned to the content through auto-classification.
Recommendations
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Sep 2021
7915 pages
Copyright © 2021.
Publisher
IEEE Press
Publication History
Published: 27 September 2021
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 31 Jan 2025