李军华,郭硕. 基于缓冲Voronoi单元的强化学习多机器人导航(特邀)[J]. 南昌航空大学学报(自然科学版),2026,40(3):61-70. doi: 10.3969/j.issn.2096-8566.2026.03.006
引用本文: 李军华,郭硕. 基于缓冲Voronoi单元的强化学习多机器人导航(特邀)[J]. 南昌航空大学学报(自然科学版),2026,40(3):61-70. doi: 10.3969/j.issn.2096-8566.2026.03.006
LI Junhua,GUO Shuo. Reinforcement learning with buffered voronoi cell for multi-robot navigation (invited)[J]. Journal of Nanchang Hangkong University (Natural Sciences),2026,40(3):61-70. doi: 10.3969/j.issn.2096-8566.2026.03.006
Citation: LI Junhua,GUO Shuo. Reinforcement learning with buffered voronoi cell for multi-robot navigation (invited)[J]. Journal of Nanchang Hangkong University (Natural Sciences),2026,40(3):61-70. doi: 10.3969/j.issn.2096-8566.2026.03.006

基于缓冲Voronoi单元的强化学习多机器人导航(特邀)

Reinforcement Learning with Buffered Voronoi Cell for Multi-Robot Navigation (Invited)

  • 摘要: 为解决多机器人避撞问题,需使每个机器人能够根据当前环境信息动态选择最优速度。然而,现有大多数多机器人避障算法在高密度环境中易陷入死锁,或为保障安全性而牺牲通行效率。为此,本文提出一种融合缓冲Voronoi单元(Buffered Voronoi Cell,BVC)与强化学习的分布式多机器人导航方法。该方法仅利用位置信息构建BVC区域,并将其作为观测输入;随后通过基于双向循环模块的神经网络将当前状态映射为导航动作,以确定合适的运动速度。奖励函数设计亦基于BVC区域与目标点之间的距离,用以预判并最小化碰撞风险。仿真实验从成功率、平均通行速度与通行时间等指标维度,对本文所提方法和主流基准方法开展对比分析。结果表明,在多种场景下,本文方法均优于RL-RVO等算法,展现出更强的适应性与有效性。

     

    Abstract: To address the collision avoidance problem in multi-robot systems, each robot is required to dynamically select an optimal velocity based on current environment information. However, most existing multi-robot collision avoidance algorithms either tend to deadlock in dense scenarios or sacrifice travel efficiency for safety. To this end, this paper proposes a distributed multi-robot navigation method that integrates buffered Voronoi cells (BVCs) with reinforcement learning. The method constructs BVC using only position information and uses them as observation inputs. A neural network based on a bidirectional gated recurrent module then maps the current state to a navigation action to determine an appropriate velocity. The reward function is also designed based on the distance between the BVC region and the target point, aiming to anticipate and minimize collision risk. Simulation experiments compared the proposed method with mainstream baseline methods in terms of metrics such as success rate, average speed, and travel time. The results indicate that the proposed method outperforms algorithms like RL-RVO across various scenarios, demonstrating superior adaptability and effectiveness.

     

/

返回文章
返回