Intelligent Ramp Control for Incident Response Using Dyna-Q Architecture
Joint Authors
Zhao, Ya-Nan
Lu, Chao
Gong, Jianwei
Source
Mathematical Problems in Engineering
Issue
Vol. 2015, Issue 2015 (31 Dec. 2015), pp.1-16, 16 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2015-10-21
Country of Publication
Egypt
No. of Pages
16
Main Subjects
Abstract EN
Reinforcement learning (RL) has shown great potential for motorway ramp control, especially under the congestion caused by incidents.
However, existing applications limited to single-agent tasks and based on Q-learning have inherent drawbacks for dealing with coordinated ramp control problems.
For solving these problems, a Dyna-Q based multiagent reinforcement learning (MARL) system named Dyna-MARL has been developed in this paper.
Dyna-Q is an extension of Q-learning, which combines model-free and model-based methods to obtain benefits from both sides.
The performance of Dyna-MARL is tested in a simulated motorway segment in the UK with the real traffic data collected from AM peak hours.
The test results compared with Isolated RL and noncontrolled situations show that Dyna-MARL can achieve a superior performance on improving the traffic operation with respect to increasing total throughput, reducing total travel time and CO2 emission.
Moreover, with a suitable coordination strategy, Dyna-MARL can maintain a highly equitable motorway system by balancing the travel time of road users from different on-ramps.
American Psychological Association (APA)
Lu, Chao& Zhao, Ya-Nan& Gong, Jianwei. 2015. Intelligent Ramp Control for Incident Response Using Dyna-Q Architecture. Mathematical Problems in Engineering،Vol. 2015, no. 2015, pp.1-16.
https://search.emarefa.net/detail/BIM-1074991
Modern Language Association (MLA)
Lu, Chao…[et al.]. Intelligent Ramp Control for Incident Response Using Dyna-Q Architecture. Mathematical Problems in Engineering No. 2015 (2015), pp.1-16.
https://search.emarefa.net/detail/BIM-1074991
American Medical Association (AMA)
Lu, Chao& Zhao, Ya-Nan& Gong, Jianwei. Intelligent Ramp Control for Incident Response Using Dyna-Q Architecture. Mathematical Problems in Engineering. 2015. Vol. 2015, no. 2015, pp.1-16.
https://search.emarefa.net/detail/BIM-1074991
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1074991