arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.16875cs.ROcs.LG
收藏

移动机器人学习多智能体多机器看护

Learning Multi-agent Multi-machine Tending by Mobile Robots

ETS Montreal(蒙特利尔工程学院);Mila - Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所);University of Calgary(卡尔加里大学)

Abdalwhab Abdalwhab, Giovanni Beltrame, Samira Ebrahimi Kahou, David St-Onge

AI总结:

本文提出基于多智能体强化学习的移动机器人多机器看护框架,集成注意力编码机制(AB-MAPPO),在任务成功率、安全性和资源利用率上优于MAPPO。

摘要:

机器人技术可以帮助解决制造业日益严重的工人短缺问题。因此,机器看护是协作机器人可以承担的一项任务,同时也能大幅提高生产力。然而,该领域现有的机器人系统依赖于固定的单臂设置,而移动机器人可以提供更大的灵活性和可扩展性。在这项工作中,我们提出了一种基于多智能体强化学习(MARL)技术的移动机器人多智能体多机器看护学习框架,并设计了合适的观测和奖励。此外,我们开发了一种基于注意力的编码机制,并将其集成到多智能体近端策略优化(MAPPO)算法中,以提升其在机器看护场景中的性能。我们的模型(AB-MAPPO)在这一新的具有挑战性的场景中,在任务成功率、安全性和资源利用率方面均优于MAPPO。此外,我们进行了广泛的消融研究,以支持我们的各种设计决策。

英文摘要:

Robotics can help address the growing worker shortage challenge of the manufacturing industry. As such, machine tending is a task collaborative robots can tackle that can also highly boost productivity. Nevertheless, existing robotics systems deployed in that sector rely on a fixed single-arm setup, whereas mobile robots can provide more flexibility and scalability. In this work, we introduce a multi-agent multi-machine tending learning framework by mobile robots based on Multi-agent Reinforcement Learning (MARL) techniques with the design of a suitable observation and reward. Moreover, an attention-based encoding mechanism is developed and integrated into Multi-agent Proximal Policy Optimization (MAPPO) algorithm to boost its performance for machine tending scenarios. Our model (AB-MAPPO) outperformed MAPPO in this new challenging scenario in terms of task success, safety, and resources utilization. Furthermore, we provided an extensive ablation study to support our various design decisions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑