论文标题
基于流量视频数据的坡道计量的深度加固学习方法
A Deep Reinforcement Learning Approach for Ramp Metering Based on Traffic Video Data
论文作者
论文摘要
使用交通信号来调节坡道的车辆流量的坡道计量已被广泛实施,以提高高速公路的车辆行动性。先前的研究通常会根据点检测器收集的预定义交通指标(例如交通量和占用)来实时更新信号时间。与点探测器相比,越来越多地在道路网络上部署的交通摄像机覆盖了更大的区域并提供了更详细的交通信息。在这项工作中,我们提出了一种深入的增强学习方法(DRL)方法,以探索交通视频数据提高坡道计量效率的潜力。提出的方法使用流量视频框架作为输入,并直接从高维视觉输入中学习了最佳控制策略。一项现实世界中的案例研究表明,与最先进的方法相比,提出的DRL方法会导致1)较低的行程时间,2)在坡道上较短的车辆队列和3)合并区域下游的交通流量较高。结果表明,所提出的方法能够从视频数据中提取有用的信息,以获得更好的坡道计量控件。
Ramp metering that uses traffic signals to regulate vehicle flows from the on-ramps has been widely implemented to improve vehicle mobility of the freeway. Previous studies generally update signal timings in real-time based on predefined traffic measures collected by point detectors, such as traffic volumes and occupancies. Comparing with point detectors, traffic cameras-which have been increasingly deployed on road networks-could cover larger areas and provide more detailed traffic information. In this work, we propose a deep reinforcement learning (DRL) method to explore the potential of traffic video data in improving the efficiency of ramp metering. The proposed method uses traffic video frames as inputs and learns the optimal control strategies directly from the high-dimensional visual inputs. A real-world case study demonstrates that, in comparison with a state-of-the-practice method, the proposed DRL method results in 1) lower travel times in the mainline, 2) shorter vehicle queues at the on-ramp, and 3) higher traffic flows downstream of the merging area. The results suggest that the proposed method is able to extract useful information from the video data for better ramp metering controls.