Abstract
Recently, automated parking has gained attention for its ability to enhance parking accuracy and provide a comfortable experience for car owners. However, with the increasing number of vehicles in the parking lot, the traditional automatic parking algorithm face the dual challenges brought by narrow parking spaces and random vehicle obstacles. To address these issues, this paper proposes Curriculum Learning RL for automatic parking decision making in unregulated parking lots. Our approach involves SAC, a reinforcement learning (RL) algorithm, for curriculum learning, where the vehicle learns to park and avoid the obstacles separately through two courses. We incorporate a reward function that considers both location and safety, facilitating continuous learning of optimal actions. In addition, we develop a simulation platform for unregulated parking lots, and we train the algorithm on this platform. Comparing our algorithm with one that learns both actions simultaneously, we observe superior results in shorter timesteps. Furthermore, experiments conducted under various parking conditions demonstrate the algorithm’s strong generalization capabilities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Al-Nussairi A K J, R.A.T.: Autonomous car driving using neural networks. In: International Conference on Applied Artificial Intelligence and Computing (ICAAIC), pp. 213–217 (2022)
Badue, C., et al.: Self-driving cars: a survey. Expert Syst. Appl. 165, 113816 (2020). https://doi.org/10.1016/j.eswa.2020.113816
Ballinas, E., Montiel, O., Castillo, O., Rubio, Y., Aguilar, L.T.: Automatic parallel parking algorithm for a car-like robot using fuzzy PD+I control. Eng. Lett. 26, 447–454 (2018)
Haarnoja, T., Zhou, A., Abbeel, P., Levine, S.: Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: Dy, J., Krause, A. (eds.) Proceedings of the 35th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 80, pp. 1861–1870. PMLR (2018)
Junzuo, L., Qiang, L.: An automatic parking model based on deep reinforcement learning. In: Journal of Physics: Conference Series, vol. 1883, p. 012111. IOP Publishing (2021)
Leurent, E.: An Environment for Autonomous Driving Decision-making. GitHub (2018)
Macek, K., Becker, M., Siegwart, R.: Motion planning for car-like vehicles in dynamic urban scenarios. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4375–4380 (2006). https://doi.org/10.1109/IROS.2006.282013
Narvekar, S., Peng, B., Leonetti, M., Sinapov, J., Taylor, M.E., Stone, P.: Curriculum learning for reinforcement learning domains: a framework and survey. J. Mach. Learn. Res. 21, 7382–7431 (2020)
Paromtchik, I., Laugier, C.: Autonomous parallel parking of a nonholonomic vehicle. In: Proceedings of Conference on Intelligent Vehicles, pp. 13–18 (1996). https://doi.org/10.1109/IVS.1996.566343
Polack, P., Altché, F., d’Andréa Novel, B., de La Fortelle, A.: The kinematic bicycle model: a consistent model for planning feasible trajectories for autonomous vehicles? In: 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 812–818 (2017). https://doi.org/10.1109/IVS.2017.7995816
Thunyapoo, B., Ratchadakorntham, C., Siricharoen, P., Susutti, W.: Self-parking car simulation using reinforcement learning approach for moderate complexity parking scenario. In: 2020 17th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), pp. 576–579. IEEE (2020)
Wang, W., Song, Y., Zhang, J., Deng, H.: Automatic parking of vehicles: a review of literatures. Int. J. Automot. Technol. 15, 967–978 (2014). https://doi.org/10.1007/s12239-014-0102-y
Zhang, J., Chen, H., Song, S., Hu, F.: Reinforcement learning-based motion planning for automatic parking system. IEEE Access 8, 154485–154501 (2020)
Zheng, H., Yang, S.: Research on race car steering geometry considering tire side slip angle. Proc. Inst. Mech. Eng. P J. Sports Eng. Technol. 234, 72–87 (2020)
Zhuang, Y., Gu, Q., Wang, B., Luo, J., Zhang, H., Liu, W.: Robust auto-parking: Reinforcement learning based real-time planning approach with domain template. In: 32nd Conference on Neural Information Processing Systems (NIPS 2018) (2018)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wei, X. et al. (2024). Reinforcement Learning-Based Algorithm for Real-Time Automated Parking Decision Making. In: Fang, L., Pei, J., Zhai, G., Wang, R. (eds) Artificial Intelligence. CICAI 2023. Lecture Notes in Computer Science(), vol 14474. Springer, Singapore. https://doi.org/10.1007/978-981-99-9119-8_22
Download citation
DOI: https://doi.org/10.1007/978-981-99-9119-8_22
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-9118-1
Online ISBN: 978-981-99-9119-8
eBook Packages: Computer ScienceComputer Science (R0)