[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3461598.3461608acmotherconferencesArticle/Chapter ViewAbstractPublication PagesismsiConference Proceedingsconference-collections
research-article

Management of Traffic Signals using Deep Reinforcement Learning in Bidirectional Recurrent Neural Network in ITS

Published: 10 August 2021 Publication History

Abstract

The traffic flow management is primarily done through traffic signals, whose inefficient control causes numerous problems, such as long waiting time and huge waste of energy. To improve traffic flow efficiency, obtaining real-time traffic information as an input and dynamically adjusting the traffic signal duration accordingly is essential. Among the existing methods, Deep Reinforcement Learning (DRL) has shown to be the most effective solution. In this paper, a dynamic mechanism to control the traffic signal of a large scale road network is proposed using policy gradient method. A single agent is trained with spatio–temporal data of the multiple intersections of the network to alleviate congestion. The proposed system is implemented in two different types of deep bidirectional Recurrent Neural Network (RNN) - Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU). The simulation experiments demonstrate that the proposed system could reduce traffic congestion in terms of different simulation metrics during high density traffic flows.

References

[1]
Chung J Choe, Seungho Baek, Bongyoung Woon, and Seung-Hyun Kong. 2018. Deep q learning with LSTM for traffic light control. In 24th Asia-Pacific Conference on Communications (APCC). IEEE, 331–336.
[2]
Deepeka Garg, Maria Chli, and George Vogiatzis. 2019. A Deep Reinforcement Learning Agent for Traffic Intersection Control Optimization. In Intelligent Transportation Systems Conference (ITSC). IEEE, 4222–4229.
[3]
Ammar Haydari and Yasin Yilmaz. 2020. Deep reinforcement learning for intelligent transportation systems: A survey. Transactions on Intelligent Transportation Systems (2020).
[4]
Lyuchao Liao, Jierui Liu, Xinke Wu, Fumin Zou, Jengshyang Pan, Qi Sun, Shengbo Eben Li, and Maolin Zhang. 2020. Time Difference Penalized Traffic Signal Timing by LSTM Q-Network to Balance Safety and Capacity at Intersections. IEEE Access 8(2020), 80086–80096.
[5]
Seyed S. Mousavi, Michael Schukat, and Enda Howley. 2017. Traffic light control using deep policy-gradient and value-function-based reinforcement learning. IET Intelligent Transport Systems 11, 7 (2017), 417–423.
[6]
Ananya Paul and Sulata Mitra. 2018. Dynamic Traffic Light Control Mechanism in VANET. In International Conference on Advances in Computing, Communications and Informatics (ICACCI). IEEE, 436–440.
[7]
Ananya Paul and Sulata Mitra. 2020. Deep Reinforcement Learning based Traffic Signal optimization for Multiple Intersections in ITS. In International Conference on Advanced Networks and Telecommunications Systems (ANTS). IEEE, 1–6.
[8]
Ananya Paul and Sulata Mitra. 2020. Real-Time Routing for ITS Enabled Fog Oriented VANET. In 17th India Council International Conference (INDICON). IEEE, 1–7.
[9]
Tianyu Wang, Teng Liang, Jun Li, Weibin Zhang, Yiji Zhang, and Yan Lin. 2020. Adaptive Traffic Signal Control Using Distributed MARL and Federated Learning. In 20th International Conference on Communication Technology (ICCT). IEEE, 1242–1248.

Cited By

View all
  • (2023)Taxi origin and destination demand prediction based on deep learning: a reviewDigital Transportation and Safety10.48130/DTS-2023-00142:3(176-189)Online publication date: 2023
  • (2022)Exploring reward efficacy in traffic management using deep reinforcement learning in intelligent transportation systemETRI Journal10.4218/etrij.2021-040444:2(194-207)Online publication date: 25-Apr-2022
  • (2022)Application of DRL in Transformer Network for Traffic Signal Management using Fog Computing in ITS2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT)10.1109/CSNT54456.2022.9787570(464-469)Online publication date: 23-Apr-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ISMSI '21: Proceedings of the 2021 5th International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence
April 2021
87 pages
ISBN:9781450389679
DOI:10.1145/3461598
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 August 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. DRL
  2. GRU
  3. LSTM
  4. Policy gradient
  5. Traffic signal control

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ISMSI 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)22
  • Downloads (Last 6 weeks)1
Reflects downloads up to 19 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Taxi origin and destination demand prediction based on deep learning: a reviewDigital Transportation and Safety10.48130/DTS-2023-00142:3(176-189)Online publication date: 2023
  • (2022)Exploring reward efficacy in traffic management using deep reinforcement learning in intelligent transportation systemETRI Journal10.4218/etrij.2021-040444:2(194-207)Online publication date: 25-Apr-2022
  • (2022)Application of DRL in Transformer Network for Traffic Signal Management using Fog Computing in ITS2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT)10.1109/CSNT54456.2022.9787570(464-469)Online publication date: 23-Apr-2022
  • (2022)An Intelligent Traffic Signal Management Strategy to Reduce Vehicles CO2 Emissions in Fog Oriented VANETWireless Personal Communications: An International Journal10.1007/s11277-021-08912-3122:1(543-576)Online publication date: 1-Jan-2022
  • (2022)Deep reinforcement learning based cooperative control of traffic signal for multi‐intersection network in intelligent transportation system using edge computingTransactions on Emerging Telecommunications Technologies10.1002/ett.458833:11Online publication date: 16-Jul-2022
  • (2021)Three Fog Computing Based Variants of Congestion Control in ITSInternational Journal of Recent Technology and Engineering (IJRTE)10.35940/ijrte.A5966.051012110:1(333-348)Online publication date: 30-May-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media