arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.11751cs.ROcs.MA
收藏

面向自主多机器人探索的高效舰队设计贝叶斯优化框架

Bayesian Optimization Framework for Efficient Fleet Design in Autonomous Multi-Robot Exploration

University of Toronto(多伦多大学);Korea Advanced Institute of Science and Technology(韩国科学技术院);Inha University(仁荷大学)

David Molina Concha, Jiping Li, Haoran Yin, Kyeonghyeon Park, Hyun-Rok Lee, Taesik Lee, Dhruv Sirohi, Chi-Guhn Lee

AI总结:

针对异构多机器人舰队设计优化中多智能体强化学习训练成本高、穷举评估不可行的问题,提出多目标贝叶斯优化框架BOFD,在性能与成本的Pareto前沿上高效探索舰队设计,并证明了次线性累积遗憾界限,实验显示其优于现有方法且评估次数极少。

摘要:

本研究解决了异构多机器人舰队背景下的舰队设计优化挑战,旨在获得平衡性能与成本的可行设计。在自主多机器人探索领域,强化学习智能体发挥着核心作用,能够适应复杂地形并促进机器人间的协作。然而,修改舰队组成会导致已学习行为发生变化,且使用多智能体强化学习训练多机器人系统成本高昂。因此,对每种潜在舰队设计进行穷举评估是不可行的。为克服这些障碍,我们提出了舰队设计贝叶斯优化(BOFD),这是一个利用多目标贝叶斯优化在性能与成本的Pareto前沿上探索舰队,同时考虑设计空间不确定性的框架。此外,我们建立了累积遗憾的次线性界限,支持了BOFD的稳健性与有效性。在合成与仿真环境中进行的大量基准实验表明,我们的框架优于最先进的方法,以最少的舰队评估实现了高效的舰队设计。

英文摘要:

This study addresses the challenge of fleet design optimization in the context of heterogeneous multi-robot fleets, aiming to obtain feasible designs that balance performance and costs. In the domain of autonomous multi-robot exploration, reinforcement learning agents play a central role, offering adaptability to complex terrains and facilitating collaboration among robots. However, modifying the fleet composition results in changes in the learned behavior, and training multi-robot systems using multi-agent reinforcement learning is expensive. Therefore, an exhaustive evaluation of each potential fleet design is infeasible. To tackle these hurdles, we introduce Bayesian Optimization for Fleet Design (BOFD), a framework leveraging multi-objective Bayesian Optimization to explore fleets on the Pareto front of performance and cost while accounting for uncertainty in the design space. Moreover, we establish a sub-linear bound for cumulative regret, supporting BOFD's robustness and efficacy. Extensive benchmark experiments in synthetic and simulated environments demonstrate the superiority of our framework over state-of-the-art methods, achieving efficient fleet designs with minimal fleet evaluations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑