面向软体机器人的拓扑驱动防缠绕控制
Topology-Driven Anti-Entanglement Control for Soft Robots
Haoyang Le, Shengxuan Wang, Mohan Chen, Shuo Feng
AI 速读 基于摘要
提出拓扑驱动的多智能体强化学习框架 TD-MARL,通过集中学习共享拓扑状态、分布式执行与拓扑安全层,协调多机器人系统在受限环境中完成解缠操作。
cs.RO · cs.AI
查看原文摘要
In the field of precision manufacturing in complex constrained environments, the role of soft robots is increasingly prominent, and the realization of anti-winding control based on multi-intelligent body reinforcement learning has become a research hotspot. One of the core problems at present is to coordinate multiple robots to complete the unwinding operation in a highly constrained environment. The existing distributed training framework faces some observability challenges in high-density barrier and unstable environments, resulting in poor learning results. This paper proposes a topology-driven Multi-Agent Reinforcement Learning (TD-MARL) framework to coordinate multi-robot systems to avoid entanglement. Specifically, the critical network adopts centralized learning, so that each intelligent body can perceive the strategies of other intelligent bodies by sharing the topological state, thus alleviating the training instability caused by complex interactions; eliminating the demand for communication resources between robots through distributed execution, Upgrade system reliability; the integrated topological security layer uses topological invariants to accurately assess and mitigate the risk of entanglement to avoid the strategy from falling into local difficulties. Finally, the full simulation experiments carried out in the real simulation environment show that the method is better than the current advanced deep reinforcement learning (DRL) method in terms of convergence and anti-winding effect.