Treffer: 基于几何路网结构和强化学习的车辆重定位策略.

The inefficient and inaccurate bidirectional search by both ride-hailing drivers and passengers leads to a mismatch between supply and demand. Ride-hailing vehicle repositioning strategy can pre-dispatch vehicles to areas with future demand, improving supply-demand matching. However, existing research mostly uses network grids to represent the urban road environment, lacking geometric topological information and reducing the dispatch accuracy. To address this issue, a ride-hailing vehicle relocation algorithm called GA2C was proposed based on Graph Neural Networks (GNN) and Actor-Critic reinforcement learning algorithm. This algorithm has a smoother learning process and can perform high-dimensional sampling, and it is suitable for learning the best relocation strategy for a large number of ride-hailing vehicles as multi-agent systems. Moreover, the geometric network structure was used to represent the urban road environment by using a GNN as a function approximator to learn the geometric information of the road network. Additionally, an action sampling strategy based on action value function was introduced to increase the randomness of action selection, effectively preventing competition. A ride-hailing vehicle relocation simulation experiment was conducted using Python, and the results are as follows: (i) the order response rate of the GA2C algorithm is 84. 2%, significantly higher than all the comparative experimental results; (ii) in the order distribution comparative experiment, GA2C’s relative improvements in uniform distribution, central distribution lay‐ out, block distribution layout, and checkerboard distribution layout are 1. 17%, 6. 02%, 13. 12%, and 14. 55%, respectively. The above experimental results demonstrate that the GA2C algorithm can effectively relocate ridehailing vehicles. When the order distribution presents significant differences, and the distance between different demand areas is relatively close, it can better learn dynamic demand changes, and achieve maximum order response rate by relocating ride-hailing vehicles. [ABSTRACT FROM AUTHOR]

网约车司机和乘客双向搜索效率低、准确性差, 造成了需求与供应之间的不 匹配。网约车重定位策略将车辆提前调度到未来有需求的地区, 提高了供需匹配度。 现有的研究大多以网络栅格表示城市道路环境, 缺少几何拓扑信息, 影响了调度准确 性。针对这一现象, 提出一种基于图神经网络 (GNN) 和执行者-评论者强化学习算法 (A2C) 的网约车重定位算法GA2C。该算法学习过程更平稳且能够高维采样, 适用于海 量网约车进行多智能体最佳重定位策略的学习, 并且使用几何路网结构表示城市道路 环境, 可以将 GNN作为函数逼近器学习路网几何信息, 此外, 引入基于动作价值函数 的动作采样策略, 增加了动作选择的随机性, 从而有效防止竞争。基于 Python 构建的 网约车重定位仿真实验结果如下：GA2C算法的订单响应率为84. 2%, 显著高于所有对 比实验结果；在订单分布对比实验结果中, GA2C在均匀分布、中心状布局、块状布局 和棋盘状布局所对应的相对提升分别为1. 17%、6. 02%、13. 12%和14. 55%。上述实验 结果表明, GA2C算法能够有效对网约车进行重定位, 当订单分布呈现明显差异性, 且 不同需求区域之间距离较近时, 能够更好的学习动态需求变化, 通过重定位网约车获 得最大订单响应率。 [ABSTRACT FROM AUTHOR]

Copyright of Journal of South China University of Technology (Natural Science Edition) is the property of South China University of Technology and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)